Jul 06 14:24:41.736088 ip-10-0-133-221 systemd[1]: Starting Kubernetes Kubelet... Jul 06 14:24:42.155411 ip-10-0-133-221 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:24:42.155411 ip-10-0-133-221 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 14:24:42.155411 ip-10-0-133-221 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:24:42.155411 ip-10-0-133-221 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 14:24:42.155411 ip-10-0-133-221 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 14:24:42.158321 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.158232 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 14:24:42.162358 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162319 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.162358 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162350 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.162358 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162356 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.162358 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162367 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162372 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162376 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162381 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162386 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162390 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162394 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162398 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162403 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162413 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162418 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162422 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162426 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162435 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162440 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162448 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162452 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162456 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162461 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.162608 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162465 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162470 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162474 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162478 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162482 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162490 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162495 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162499 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162503 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162510 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162514 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162518 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162523 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162530 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162535 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162542 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162547 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162552 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162562 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162567 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.163328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162573 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162578 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162583 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162589 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162594 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162601 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162606 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162611 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162621 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162627 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162638 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162643 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162647 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162652 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162659 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162664 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162669 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162674 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162679 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.163866 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162686 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162690 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162695 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162704 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162709 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162714 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162719 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162724 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162729 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162733 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162738 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162743 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162748 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162752 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162756 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162761 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162790 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162795 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162800 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162803 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.164360 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162808 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162812 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162816 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162820 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162825 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162829 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162836 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162844 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162849 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162853 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162857 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162862 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162866 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162872 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162878 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162882 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.162887 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164130 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164139 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164144 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.164862 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164147 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164150 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164153 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164156 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164159 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164162 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164165 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164168 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164172 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164176 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164180 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164183 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164188 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164192 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164195 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164198 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164200 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164203 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164206 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.165359 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164209 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164212 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164215 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164219 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164222 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164225 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164227 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164230 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164233 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164235 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164239 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164242 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164245 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164248 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164251 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164253 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164256 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164259 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.165845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164261 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164264 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164266 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164269 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164272 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164274 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164277 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164279 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164282 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164286 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164288 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164291 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164294 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164296 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164299 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164302 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164305 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164308 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164310 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164313 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.166308 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164316 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164318 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164321 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164323 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164327 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164332 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164335 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164338 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164341 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164345 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164348 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164350 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164353 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164356 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164358 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164361 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164364 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164367 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164369 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.166821 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164372 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164375 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164378 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164381 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164383 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164386 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164388 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164391 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164393 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164396 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164398 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164401 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164403 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164406 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164408 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164411 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164414 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164417 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164419 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.167283 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164836 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164841 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164845 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164849 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164853 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164856 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164858 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164861 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164864 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164866 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164869 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164872 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164875 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164878 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164880 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164884 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164887 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164890 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164893 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.167755 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164895 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164898 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164901 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164903 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164905 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164908 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164913 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164916 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164919 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164922 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164925 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164928 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164932 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164935 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164938 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164941 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164944 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164946 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164949 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.168234 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164951 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164954 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164957 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164959 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164962 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164967 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164970 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164973 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164976 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164979 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164982 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164985 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164988 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164991 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164994 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164996 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.164999 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165001 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165004 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165006 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.168691 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165009 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165011 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165014 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165016 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165020 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165023 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165026 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165028 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165031 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165034 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165036 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165039 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165041 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165044 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165046 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165049 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165051 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165054 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165056 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165059 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.169229 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165061 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165064 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165066 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165069 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165074 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165077 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165079 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165082 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165085 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165087 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165089 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165092 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165095 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165097 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165100 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165102 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165105 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165110 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165113 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165116 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.169727 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165118 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165191 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165198 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165204 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165209 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165213 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165216 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165222 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165230 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165233 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165237 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165240 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165243 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165246 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165249 2578 flags.go:64] FLAG: --cgroup-root="" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165252 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165255 2578 flags.go:64] FLAG: --client-ca-file="" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165259 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165262 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165267 2578 flags.go:64] FLAG: --cluster-domain="" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165270 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165273 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165276 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165279 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 14:24:42.170316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165283 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165286 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165289 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165292 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165295 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165300 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165303 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165306 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165309 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165313 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165316 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165319 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165322 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165325 2578 flags.go:64] FLAG: --enable-server="true" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165328 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165332 2578 flags.go:64] FLAG: --event-burst="100" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165335 2578 flags.go:64] FLAG: --event-qps="50" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165338 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165341 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165344 2578 flags.go:64] FLAG: --eviction-hard="" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165348 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165351 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165354 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165357 2578 flags.go:64] FLAG: --eviction-soft="" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165360 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 14:24:42.170922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165363 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165367 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165370 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165373 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165375 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165378 2578 flags.go:64] FLAG: --feature-gates="" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165382 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165385 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165388 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165391 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165394 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165397 2578 flags.go:64] FLAG: --help="false" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165401 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165405 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165407 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165410 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165413 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165417 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165420 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165423 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165425 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165428 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165431 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165435 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 14:24:42.171533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165437 2578 flags.go:64] FLAG: --kube-reserved="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165440 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165443 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165446 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165449 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165451 2578 flags.go:64] FLAG: --lock-file="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165454 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165457 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165460 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165465 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165469 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165471 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165474 2578 flags.go:64] FLAG: --logging-format="text" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165477 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165480 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165483 2578 flags.go:64] FLAG: --manifest-url="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165486 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165491 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165495 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165499 2578 flags.go:64] FLAG: --max-pods="110" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165503 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165506 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165509 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165512 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165515 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 14:24:42.172158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165518 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165521 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165528 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165531 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165534 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165538 2578 flags.go:64] FLAG: --pod-cidr="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165540 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165547 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165549 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165553 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165555 2578 flags.go:64] FLAG: --port="10250" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165558 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165561 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0120245d885245a3d" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165564 2578 flags.go:64] FLAG: --qos-reserved="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165567 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165571 2578 flags.go:64] FLAG: --register-node="true" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165574 2578 flags.go:64] FLAG: --register-with-taints="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165577 2578 flags.go:64] FLAG: --registry-burst="10" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165581 2578 flags.go:64] FLAG: --registry-qps="5" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165584 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165587 2578 flags.go:64] FLAG: --reserved-memory="" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165590 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165593 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165596 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165599 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 14:24:42.172867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165603 2578 flags.go:64] FLAG: --runonce="false" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165606 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165609 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165613 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165616 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165619 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165622 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165625 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165628 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165631 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165634 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165637 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165640 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165643 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165646 2578 flags.go:64] FLAG: --system-cgroups="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165649 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165654 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165657 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165659 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165664 2578 flags.go:64] FLAG: --tls-min-version="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165667 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165669 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165672 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165675 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165678 2578 flags.go:64] FLAG: --v="2" Jul 06 14:24:42.173484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165684 2578 flags.go:64] FLAG: --version="false" Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165689 2578 flags.go:64] FLAG: --vmodule="" Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165692 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.165696 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165829 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165834 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165837 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165842 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165844 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165847 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165851 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165854 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165856 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165859 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165862 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165864 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165868 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165870 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165873 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165876 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.174113 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165878 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165881 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165884 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165886 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165889 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165891 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165894 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165897 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165900 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165902 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165905 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165907 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165910 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165914 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165918 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165921 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165924 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165927 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165930 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165935 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.174605 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165938 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165941 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165944 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165947 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165950 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165953 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165956 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165959 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165962 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165965 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165967 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165970 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165973 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165976 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165979 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165981 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165984 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165987 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165990 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.175110 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165993 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165996 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.165998 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166001 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166003 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166006 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166009 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166012 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166015 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166017 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166020 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166022 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166027 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166030 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166033 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166036 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166039 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166043 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166046 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166048 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.175575 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166051 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166053 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166057 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166061 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166064 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166067 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166069 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166072 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166075 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166078 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166081 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166084 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166086 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166089 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166091 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166094 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166096 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166099 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166101 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.176095 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166104 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166106 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166110 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166112 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.166115 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.166737 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.173817 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.173834 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.174618 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.174628 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174693 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174698 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174701 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174705 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.176554 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174708 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174711 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174716 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174720 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174724 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174727 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174730 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174732 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174735 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174738 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174741 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174744 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174746 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174749 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174752 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174755 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174757 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174760 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174777 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.176914 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174782 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174786 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174789 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174794 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174797 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174801 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174804 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174807 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174810 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174812 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174815 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174821 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174824 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174826 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174829 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174831 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174834 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174837 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.177381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174840 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174842 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174845 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174848 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174850 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174853 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174856 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174858 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174861 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174863 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174866 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174868 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174871 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174874 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174877 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174881 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174884 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174887 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174891 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174894 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.177939 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174897 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174900 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174903 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174905 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174908 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174911 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174913 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174916 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174918 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174921 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174923 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174926 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174929 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174931 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174934 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174936 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174939 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174941 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174944 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174947 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.178455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174949 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174952 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174954 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174957 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174962 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174965 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174968 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174971 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174974 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174977 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174982 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174984 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174987 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174990 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174993 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.178966 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.174995 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.175001 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175134 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175139 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175142 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175145 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175149 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175152 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175155 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175159 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175162 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175165 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175169 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175172 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 14:24:42.179355 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175175 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175179 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175182 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175184 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175187 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175190 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175192 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175195 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175197 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175200 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175203 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175206 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175208 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175211 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175214 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175220 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175223 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175225 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175228 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 14:24:42.179720 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175230 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175233 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175235 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175238 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175240 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175243 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175245 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175248 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175250 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175253 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175255 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175258 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175260 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175263 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175265 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175268 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175272 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175275 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175278 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 14:24:42.180220 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175281 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175284 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175287 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175290 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175293 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175296 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175299 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175302 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175305 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175308 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175317 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175320 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175323 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175326 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175328 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175331 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175333 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175336 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175338 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175341 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 14:24:42.180671 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175344 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175347 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175350 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175352 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175355 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175357 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175360 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175363 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175365 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175368 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175370 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175373 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175375 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175378 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175381 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175383 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175386 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175389 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175391 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175394 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 14:24:42.181166 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175397 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175399 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175402 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175411 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175413 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175416 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175419 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:42.175421 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.175426 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.175577 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.177673 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.179082 2578 server.go:1019] "Starting client certificate rotation" Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.179196 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:24:42.181677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.179812 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 14:24:42.182155 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.181905 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:24:42.185797 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.185759 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 14:24:42.196067 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.196043 2578 log.go:25] "Validated CRI v1 runtime API" Jul 06 14:24:42.198277 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.198261 2578 log.go:25] "Validated CRI v1 image API" Jul 06 14:24:42.200275 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.200253 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 14:24:42.202544 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.202513 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ce0f53d1-96e9-4aa8-a1ed-df9281e9ba14:/dev/nvme0n1p3 ee84714e-360d-46e7-8b95-33d266d17ab2:/dev/nvme0n1p4] Jul 06 14:24:42.202642 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.202541 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 14:24:42.206427 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.206407 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:24:42.208741 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.208621 2578 manager.go:216] Machine: {Timestamp:2026-07-06 14:24:42.206657608 +0000 UTC m=+0.349146232 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099433 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239524945e50531e660a9d0175ae00 SystemUUID:ec239524-945e-5053-1e66-0a9d0175ae00 BootID:5a6643b8-4e6c-47a9-8bc5-6ba36746375b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:80:eb:ce:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:80:eb:ce:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:74:ba:f2:0b:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 14:24:42.208741 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.208735 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 14:24:42.208938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.208875 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 14:24:42.210016 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.209986 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 14:24:42.210189 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.210019 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 14:24:42.210809 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.210797 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 14:24:42.210863 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.210814 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 14:24:42.210863 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.210824 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:24:42.211436 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.211425 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 14:24:42.212824 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.212812 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 14:24:42.215622 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215608 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:24:42.215792 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215761 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 14:24:42.215851 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215819 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 06 14:24:42.215851 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215833 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 14:24:42.215851 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215848 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 14:24:42.215982 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215862 2578 kubelet.go:398] "Adding apiserver pod source" Jul 06 14:24:42.215982 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.215879 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 14:24:42.216305 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.216292 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:24:42.216371 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.216316 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 14:24:42.218732 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.218717 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 14:24:42.220488 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.220474 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 14:24:42.220550 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.220505 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 14:24:42.221499 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221487 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 14:24:42.221536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221503 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 14:24:42.221536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221509 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 14:24:42.221536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221515 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 14:24:42.221536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221523 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 14:24:42.221536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221532 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221544 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221553 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221564 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221570 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221579 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 14:24:42.221668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.221584 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 14:24:42.224049 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.224036 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 14:24:42.224049 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.224048 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 14:24:42.225983 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.225946 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 14:24:42.226616 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.226595 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 14:24:42.226667 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.226595 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 14:24:42.227367 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.227356 2578 server.go:1268] "Started kubelet" Jul 06 14:24:42.227484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.227433 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 14:24:42.227534 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.227507 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 14:24:42.227534 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.227510 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 14:24:42.228284 ip-10-0-133-221 systemd[1]: Started Kubernetes Kubelet. Jul 06 14:24:42.229064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.229046 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 14:24:42.233853 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.233834 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 06 14:24:42.235048 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.235008 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 14:24:42.238203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.238181 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 14:24:42.238372 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.238345 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.238577 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.238564 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 14:24:42.238978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.238959 2578 factory.go:55] Registering systemd factory Jul 06 14:24:42.238978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.238980 2578 factory.go:223] Registration of the systemd container factory successfully Jul 06 14:24:42.239110 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239087 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 14:24:42.239110 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239106 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 14:24:42.239195 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239116 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 14:24:42.239353 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239339 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 06 14:24:42.239353 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239351 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 06 14:24:42.239478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239343 2578 factory.go:153] Registering CRI-O factory Jul 06 14:24:42.239478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239372 2578 factory.go:223] Registration of the crio container factory successfully Jul 06 14:24:42.239478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239418 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 14:24:42.239478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239442 2578 factory.go:103] Registering Raw factory Jul 06 14:24:42.239478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239456 2578 manager.go:1196] Started watching for new ooms in manager Jul 06 14:24:42.239963 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.239927 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7wsb" Jul 06 14:24:42.240232 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.240205 2578 manager.go:349] Starting recovery of all containers Jul 06 14:24:42.242488 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.242454 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 14:24:42.242894 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.242871 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 14:24:42.243804 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.242816 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-221.ec2.internal.18bfb973471ae701 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-221.ec2.internal,UID:ip-10-0-133-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-221.ec2.internal,},FirstTimestamp:2026-07-06 14:24:42.227328769 +0000 UTC m=+0.369817395,LastTimestamp:2026-07-06 14:24:42.227328769 +0000 UTC m=+0.369817395,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-221.ec2.internal,}" Jul 06 14:24:42.248064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.247923 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7wsb" Jul 06 14:24:42.248064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.248033 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 14:24:42.250035 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.250019 2578 manager.go:354] Recovery completed Jul 06 14:24:42.255134 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.255117 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.256913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.256897 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.256992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.256929 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.256992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.256942 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.257376 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.257360 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 14:24:42.257432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.257375 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 14:24:42.257432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.257395 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 14:24:42.257432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.257407 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.258143 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258127 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.258213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258156 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.258213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258170 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.258689 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258678 2578 policy_none.go:49] "None policy: Start" Jul 06 14:24:42.258728 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258694 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 14:24:42.258728 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.258705 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 14:24:42.259925 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.259791 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-221.ec2.internal.18bfb97348de5484 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-221.ec2.internal,UID:ip-10-0-133-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-221.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-221.ec2.internal,},FirstTimestamp:2026-07-06 14:24:42.25691354 +0000 UTC m=+0.399402166,LastTimestamp:2026-07-06 14:24:42.25691354 +0000 UTC m=+0.399402166,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-221.ec2.internal,}" Jul 06 14:24:42.260089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.260074 2578 policy_none.go:47] "Start" Jul 06 14:24:42.301469 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.301444 2578 manager.go:337] "Starting Device Plugin manager" Jul 06 14:24:42.301628 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.301493 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 14:24:42.301628 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.301504 2578 server.go:87] "Starting device plugin registration server" Jul 06 14:24:42.301799 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.301787 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 14:24:42.301834 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.301801 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 14:24:42.301938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.301916 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 14:24:42.302051 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.302022 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 14:24:42.302051 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.302038 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 14:24:42.302652 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.302633 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 14:24:42.302732 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.302680 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.401955 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.401923 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.403095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.403081 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.403169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.403112 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.403169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.403126 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.403169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.403151 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.413884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.413862 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.413977 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.413885 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-221.ec2.internal\": node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.426840 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.426816 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.448782 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.448751 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 14:24:42.448900 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.448802 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 14:24:42.448900 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.448826 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 14:24:42.448900 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.448854 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 14:24:42.450688 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.450670 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:24:42.527078 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.527042 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.549470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.549436 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal"] Jul 06 14:24:42.549546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.549515 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.550513 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.550493 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.550587 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.550536 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.550587 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.550549 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.552098 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552085 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.552204 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552191 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.552249 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552227 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.552836 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552817 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.552836 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552830 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.552997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552847 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.552997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552853 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.552997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552862 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.552997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.552876 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.554004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.553990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.554051 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.554020 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 14:24:42.554697 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.554681 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientMemory" Jul 06 14:24:42.554801 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.554707 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 14:24:42.554801 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.554716 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeHasSufficientPID" Jul 06 14:24:42.584439 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.584414 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-221.ec2.internal\" not found" node="ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.588753 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.588739 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-221.ec2.internal\" not found" node="ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.627671 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.627643 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.640828 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.640803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.640916 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.640833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.640916 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.640857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f9f05fde052bd22d7e2259b719ab44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-221.ec2.internal\" (UID: \"42f9f05fde052bd22d7e2259b719ab44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.728301 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.728241 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.741569 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.741623 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.741623 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f9f05fde052bd22d7e2259b719ab44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-221.ec2.internal\" (UID: \"42f9f05fde052bd22d7e2259b719ab44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.741687 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42f9f05fde052bd22d7e2259b719ab44-config\") pod \"kube-apiserver-proxy-ip-10-0-133-221.ec2.internal\" (UID: \"42f9f05fde052bd22d7e2259b719ab44\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.741687 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.741687 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.741678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/753622b084703277fac3a274ae8f2803-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal\" (UID: \"753622b084703277fac3a274ae8f2803\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.828735 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.828706 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:42.888263 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.888231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.892230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:42.892126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:42.929831 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:42.929799 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.030659 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.030589 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.137175 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.137134 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.179525 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.179485 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 14:24:43.180168 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.179656 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 14:24:43.237241 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.237205 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.239424 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.239404 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:24:43.251323 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.251277 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:19:42 +0000 UTC" deadline="2027-12-27 04:46:59.642201554 +0000 UTC" Jul 06 14:24:43.251323 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.251313 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12926h22m16.390891611s" Jul 06 14:24:43.337320 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.337281 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.406326 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:43.406289 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f9f05fde052bd22d7e2259b719ab44.slice/crio-22f2ee6e9a1ed157356d7290115b5bb63ed880fc23ae333f004ef95b47afbab3 WatchSource:0}: Error finding container 22f2ee6e9a1ed157356d7290115b5bb63ed880fc23ae333f004ef95b47afbab3: Status 404 returned error can't find the container with id 22f2ee6e9a1ed157356d7290115b5bb63ed880fc23ae333f004ef95b47afbab3 Jul 06 14:24:43.406550 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:43.406533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753622b084703277fac3a274ae8f2803.slice/crio-e1092f82d5ec9ed96686bedfab169cf042528a29f702e25882d2a7bd9f2026a3 WatchSource:0}: Error finding container e1092f82d5ec9ed96686bedfab169cf042528a29f702e25882d2a7bd9f2026a3: Status 404 returned error can't find the container with id e1092f82d5ec9ed96686bedfab169cf042528a29f702e25882d2a7bd9f2026a3 Jul 06 14:24:43.412926 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.412910 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:24:43.437829 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.437785 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.452679 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.452609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" event={"ID":"753622b084703277fac3a274ae8f2803","Type":"ContainerStarted","Data":"e1092f82d5ec9ed96686bedfab169cf042528a29f702e25882d2a7bd9f2026a3"} Jul 06 14:24:43.453632 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.453609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" event={"ID":"42f9f05fde052bd22d7e2259b719ab44","Type":"ContainerStarted","Data":"22f2ee6e9a1ed157356d7290115b5bb63ed880fc23ae333f004ef95b47afbab3"} Jul 06 14:24:43.542526 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.542490 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.643620 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.643535 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.743904 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:43.743874 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-221.ec2.internal\" not found" Jul 06 14:24:43.761691 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.761670 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:24:43.817128 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.817106 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:24:43.839960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.839931 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" Jul 06 14:24:43.855046 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.855022 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:24:43.856118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.856104 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" Jul 06 14:24:43.866229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:43.866180 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 14:24:44.002397 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.002362 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 14:24:44.219157 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.219104 2578 apiserver.go:52] "Watching apiserver" Jul 06 14:24:44.232402 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.232202 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 14:24:44.233578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.233546 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl","openshift-image-registry/node-ca-h7wqq","openshift-multus/multus-additional-cni-plugins-hg98v","openshift-multus/multus-snk4k","openshift-ovn-kubernetes/ovnkube-node-j4kxx","kube-system/global-pull-secret-syncer-gmkl8","kube-system/konnectivity-agent-cf4k6","openshift-cluster-node-tuning-operator/tuned-fcmsj","openshift-dns/node-resolver-jxqkf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal","openshift-multus/network-metrics-daemon-r8lgl","openshift-network-diagnostics/network-check-target-f9kmf","openshift-network-operator/iptables-alerter-fmmpz"] Jul 06 14:24:44.235359 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.235327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.236947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.236927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.238200 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.238179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.238380 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.238325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:44.238750 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.238565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wh6cl\"" Jul 06 14:24:44.238901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.238882 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 14:24:44.238984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.238937 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 14:24:44.240952 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.239534 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 14:24:44.240952 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.240470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.240952 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.240682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 14:24:44.241227 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.241018 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.241780 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.241521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hdqfq\"" Jul 06 14:24:44.241969 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.241948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.243502 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.243481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.246127 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.246110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgmrw\"" Jul 06 14:24:44.246504 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.246484 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.246884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.246865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 14:24:44.247105 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247085 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 14:24:44.247202 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 14:24:44.247202 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247135 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.247202 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 14:24:44.247379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.247632 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9m7z\"" Jul 06 14:24:44.247960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.247976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff848a7-2a35-49ce-8f8f-bdf507f316a6-konnectivity-ca\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.248072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl9ct\" (UniqueName: \"kubernetes.io/projected/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kube-api-access-kl9ct\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-os-release\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248281 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff848a7-2a35-49ce-8f8f-bdf507f316a6-agent-certs\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.248281 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-sys-fs\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248281 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.248281 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-system-cni-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-socket-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-device-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.248483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-kubelet-config\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-dbus\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-cnibin\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zd6n\" (UniqueName: \"kubernetes.io/projected/e95d2ec3-f43a-4102-af41-0754a3e2711d-kube-api-access-6zd6n\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.248723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.248698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-registration-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.249212 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.249202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.251936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.251769 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 14:24:44.252212 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.252189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 14:24:44.252476 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.252428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.252928 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.252909 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 14:24:44.253221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.253191 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5thkm\"" Jul 06 14:24:44.253524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.253503 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.253767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.253749 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.255591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.253955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 14:24:44.255591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.254180 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 14:24:44.255591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.254364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c9xdf\"" Jul 06 14:24:44.255591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.254537 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.255591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.254873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.260327 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.260302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.260422 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.260396 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:44.261287 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.261253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.261404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.261385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vzzgw\"" Jul 06 14:24:44.261667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.261650 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.264251 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.263523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.264362 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.264327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:44.264430 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.264408 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:44.267372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.267353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.274301 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.274280 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.274568 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.274544 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 14:24:44.274658 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.274593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 14:24:44.274658 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.274644 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.274992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.274974 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:24:44.275219 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.275067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pqgxw\"" Jul 06 14:24:44.276139 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.276119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-skqzn\"" Jul 06 14:24:44.282915 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.282725 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 14:24:44.296850 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.296828 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rq7d4" Jul 06 14:24:44.308197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.308174 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rq7d4" Jul 06 14:24:44.340248 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.340222 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 14:24:44.349230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-cnibin\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.349230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-config\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-tmp\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2q4t\" (UniqueName: \"kubernetes.io/projected/a9f28289-ce6b-4785-9ceb-303843d79744-kube-api-access-k2q4t\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-k8s-cni-cncf-io\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-etc-kubernetes\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.349448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-os-release\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-sys-fs\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-socket-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwp6\" (UniqueName: \"kubernetes.io/projected/82a5b689-bc4f-4362-b551-a9eb79e0805d-kube-api-access-4fwp6\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82a5b689-bc4f-4362-b551-a9eb79e0805d-host\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-kubelet-config\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-script-lib\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfcq\" (UniqueName: \"kubernetes.io/projected/982d433c-c140-48f9-b9a8-4368f871e26c-kube-api-access-vcfcq\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cni-binary-copy\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-systemd\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.349791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2ba4196-f4d5-466d-be3b-36dfacebd587-host-slash\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-systemd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-ovn\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82a5b689-bc4f-4362-b551-a9eb79e0805d-serviceca\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-tmp-dir\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.349992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-kubelet\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-netd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-socket-dir-parent\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-modprobe-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-hosts-file\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.350240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-device-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-etc-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zd6n\" (UniqueName: \"kubernetes.io/projected/e95d2ec3-f43a-4102-af41-0754a3e2711d-kube-api-access-6zd6n\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-env-overrides\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-netns\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-daemon-config\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-multus-certs\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-conf\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-host\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-registration-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-node-log\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-os-release\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-hostroot\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-var-lib-kubelet\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl9ct\" (UniqueName: \"kubernetes.io/projected/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kube-api-access-kl9ct\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-slash\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-netns\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.350761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/982d433c-c140-48f9-b9a8-4368f871e26c-ovn-node-metrics-cert\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7588g\" (UniqueName: \"kubernetes.io/projected/734711a3-24d4-4b03-9387-3d5ac7faa6b9-kube-api-access-7588g\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-run\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-lib-modules\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-log-socket\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysconfig\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-etc-tuned\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpgxj\" (UniqueName: \"kubernetes.io/projected/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-kube-api-access-zpgxj\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-dbus\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2ba4196-f4d5-466d-be3b-36dfacebd587-iptables-alerter-script\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjltq\" (UniqueName: \"kubernetes.io/projected/a2ba4196-f4d5-466d-be3b-36dfacebd587-kube-api-access-gjltq\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-bin\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cnibin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp64n\" (UniqueName: \"kubernetes.io/projected/96cd5eec-0129-4975-a3f3-c3d369923118-kube-api-access-gp64n\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff848a7-2a35-49ce-8f8f-bdf507f316a6-konnectivity-ca\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-var-lib-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-system-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-bin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-multus\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-sys\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff848a7-2a35-49ce-8f8f-bdf507f316a6-agent-certs\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-systemd-units\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-conf-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.350988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-kubelet\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-system-cni-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-kubernetes\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351107 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-cnibin\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351207 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-os-release\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-sys-fs\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.351767 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-socket-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-kubelet-config\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.351806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.352055 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.352321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-device-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.352346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b0d5885-d8ea-4834-96d2-8fe004010744-dbus\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.352394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.352560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.352426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-binary-copy\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-registration-dir\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.353358 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:44.853332701 +0000 UTC m=+2.995821337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e95d2ec3-f43a-4102-af41-0754a3e2711d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-system-cni-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e95d2ec3-f43a-4102-af41-0754a3e2711d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.353925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff848a7-2a35-49ce-8f8f-bdf507f316a6-konnectivity-ca\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.354363 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.353916 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 14:24:44.358097 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.358074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff848a7-2a35-49ce-8f8f-bdf507f316a6-agent-certs\") pod \"konnectivity-agent-cf4k6\" (UID: \"cff848a7-2a35-49ce-8f8f-bdf507f316a6\") " pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.392374 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.392346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl9ct\" (UniqueName: \"kubernetes.io/projected/2fb16fa0-fe34-4e88-8dde-256d20bf35c6-kube-api-access-kl9ct\") pod \"aws-ebs-csi-driver-node-2f4rl\" (UID: \"2fb16fa0-fe34-4e88-8dde-256d20bf35c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.394017 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.393989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zd6n\" (UniqueName: \"kubernetes.io/projected/e95d2ec3-f43a-4102-af41-0754a3e2711d-kube-api-access-6zd6n\") pod \"multus-additional-cni-plugins-hg98v\" (UID: \"e95d2ec3-f43a-4102-af41-0754a3e2711d\") " pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.451823 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2q4t\" (UniqueName: \"kubernetes.io/projected/a9f28289-ce6b-4785-9ceb-303843d79744-kube-api-access-k2q4t\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-k8s-cni-cncf-io\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-etc-kubernetes\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwp6\" (UniqueName: \"kubernetes.io/projected/82a5b689-bc4f-4362-b551-a9eb79e0805d-kube-api-access-4fwp6\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82a5b689-bc4f-4362-b551-a9eb79e0805d-host\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.451978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-script-lib\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfcq\" (UniqueName: \"kubernetes.io/projected/982d433c-c140-48f9-b9a8-4368f871e26c-kube-api-access-vcfcq\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cni-binary-copy\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-systemd\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2ba4196-f4d5-466d-be3b-36dfacebd587-host-slash\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-systemd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-ovn\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82a5b689-bc4f-4362-b551-a9eb79e0805d-serviceca\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-tmp-dir\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-kubelet\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-netd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-socket-dir-parent\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-modprobe-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-hosts-file\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-k8s-cni-cncf-io\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-etc-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-env-overrides\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-systemd\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-netd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-etc-kubernetes\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.452899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-ovn\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.452942 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.452899 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-modprobe-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.453046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:44.952998664 +0000 UTC m=+3.095487298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-hosts-file\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-systemd\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82a5b689-bc4f-4362-b551-a9eb79e0805d-host\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-tmp-dir\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-socket-dir-parent\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.453770 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-env-overrides\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-netns\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-daemon-config\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-multus-certs\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82a5b689-bc4f-4362-b551-a9eb79e0805d-serviceca\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.453977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-conf\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-kubelet\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-host\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-node-log\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-etc-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-os-release\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-conf\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-netns\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-host\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2ba4196-f4d5-466d-be3b-36dfacebd587-host-slash\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-hostroot\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-node-log\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-var-lib-kubelet\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.454274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-hostroot\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-slash\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-netns\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-script-lib\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/982d433c-c140-48f9-b9a8-4368f871e26c-ovn-node-metrics-cert\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7588g\" (UniqueName: \"kubernetes.io/projected/734711a3-24d4-4b03-9387-3d5ac7faa6b9-kube-api-access-7588g\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-os-release\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-netns\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-run\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-var-lib-kubelet\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-run-multus-certs\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-slash\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cni-binary-copy\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-lib-modules\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-log-socket\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-run\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-log-socket\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.455500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-daemon-config\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-lib-modules\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysconfig\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-run-ovn-kubernetes\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-etc-tuned\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpgxj\" (UniqueName: \"kubernetes.io/projected/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-kube-api-access-zpgxj\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2ba4196-f4d5-466d-be3b-36dfacebd587-iptables-alerter-script\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysconfig\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjltq\" (UniqueName: \"kubernetes.io/projected/a2ba4196-f4d5-466d-be3b-36dfacebd587-kube-api-access-gjltq\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-bin\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.454974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cnibin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp64n\" (UniqueName: \"kubernetes.io/projected/96cd5eec-0129-4975-a3f3-c3d369923118-kube-api-access-gp64n\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-var-lib-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-system-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-bin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-multus\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-sys\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.456480 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-systemd-units\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-conf-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-kubelet\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-kubernetes\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-config\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-tmp\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.455592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-multus\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2ba4196-f4d5-466d-be3b-36dfacebd587-iptables-alerter-script\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-var-lib-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-system-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-sysctl-d\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-host-var-lib-cni-bin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456599 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-cni-bin\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-sys\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-run-openvswitch\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.457421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-conf-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-systemd-units\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cd5eec-0129-4975-a3f3-c3d369923118-etc-kubernetes\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-cnibin\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456764 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/982d433c-c140-48f9-b9a8-4368f871e26c-host-kubelet\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.456813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734711a3-24d4-4b03-9387-3d5ac7faa6b9-multus-cni-dir\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.457334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/982d433c-c140-48f9-b9a8-4368f871e26c-ovnkube-config\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.458432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.458253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-etc-tuned\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.460258 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.459642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cd5eec-0129-4975-a3f3-c3d369923118-tmp\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.461129 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.461107 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/982d433c-c140-48f9-b9a8-4368f871e26c-ovn-node-metrics-cert\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.470731 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.470702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfcq\" (UniqueName: \"kubernetes.io/projected/982d433c-c140-48f9-b9a8-4368f871e26c-kube-api-access-vcfcq\") pod \"ovnkube-node-j4kxx\" (UID: \"982d433c-c140-48f9-b9a8-4368f871e26c\") " pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.473210 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.472899 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:24:44.473210 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.472926 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:24:44.473210 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.472952 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:44.473210 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.473019 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:44.973000523 +0000 UTC m=+3.115489140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:44.473210 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.473150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2q4t\" (UniqueName: \"kubernetes.io/projected/a9f28289-ce6b-4785-9ceb-303843d79744-kube-api-access-k2q4t\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.474366 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.474343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwp6\" (UniqueName: \"kubernetes.io/projected/82a5b689-bc4f-4362-b551-a9eb79e0805d-kube-api-access-4fwp6\") pod \"node-ca-h7wqq\" (UID: \"82a5b689-bc4f-4362-b551-a9eb79e0805d\") " pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.485321 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.485295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjltq\" (UniqueName: \"kubernetes.io/projected/a2ba4196-f4d5-466d-be3b-36dfacebd587-kube-api-access-gjltq\") pod \"iptables-alerter-fmmpz\" (UID: \"a2ba4196-f4d5-466d-be3b-36dfacebd587\") " pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.487761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.487733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpgxj\" (UniqueName: \"kubernetes.io/projected/cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4-kube-api-access-zpgxj\") pod \"node-resolver-jxqkf\" (UID: \"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4\") " pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.491953 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.491933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp64n\" (UniqueName: \"kubernetes.io/projected/96cd5eec-0129-4975-a3f3-c3d369923118-kube-api-access-gp64n\") pod \"tuned-fcmsj\" (UID: \"96cd5eec-0129-4975-a3f3-c3d369923118\") " pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.492139 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.492120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7588g\" (UniqueName: \"kubernetes.io/projected/734711a3-24d4-4b03-9387-3d5ac7faa6b9-kube-api-access-7588g\") pod \"multus-snk4k\" (UID: \"734711a3-24d4-4b03-9387-3d5ac7faa6b9\") " pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.550597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.550514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:44.566757 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.566725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" Jul 06 14:24:44.577692 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.577664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hg98v" Jul 06 14:24:44.587864 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.587836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-snk4k" Jul 06 14:24:44.608181 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.608147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:24:44.614358 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.614332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7wqq" Jul 06 14:24:44.624651 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.624628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" Jul 06 14:24:44.632498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.632461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jxqkf" Jul 06 14:24:44.640383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.640360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmmpz" Jul 06 14:24:44.858526 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.858430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:44.858696 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.858614 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:44.858748 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.858697 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:45.858679208 +0000 UTC m=+4.001167845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:44.959152 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:44.959115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:44.959317 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.959292 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:44.959388 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:44.959370 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:45.959353967 +0000 UTC m=+4.101842583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:45.060167 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.060125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:45.060363 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.060280 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:24:45.060363 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.060301 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:24:45.060363 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.060313 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:45.060528 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.060383 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:46.060361734 +0000 UTC m=+4.202850349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:45.312090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.312027 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:19:44 +0000 UTC" deadline="2028-04-07 05:49:38.125077346 +0000 UTC" Jul 06 14:24:45.312090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.312087 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15375h24m52.812997331s" Jul 06 14:24:45.449225 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.449190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:45.449383 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.449355 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:45.586203 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.586133 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa5c9fe_3db4_4fb4_9e1d_f3132ffa70d4.slice/crio-2408168027be1230c446b872bb734e613a27dc25d8c099220d3bb2a8fe2318cb WatchSource:0}: Error finding container 2408168027be1230c446b872bb734e613a27dc25d8c099220d3bb2a8fe2318cb: Status 404 returned error can't find the container with id 2408168027be1230c446b872bb734e613a27dc25d8c099220d3bb2a8fe2318cb Jul 06 14:24:45.590328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.590291 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95d2ec3_f43a_4102_af41_0754a3e2711d.slice/crio-31b37d87241fdf4ac1efdc3c7bab20aa4555afe7a70237cafc050b179cf19fd2 WatchSource:0}: Error finding container 31b37d87241fdf4ac1efdc3c7bab20aa4555afe7a70237cafc050b179cf19fd2: Status 404 returned error can't find the container with id 31b37d87241fdf4ac1efdc3c7bab20aa4555afe7a70237cafc050b179cf19fd2 Jul 06 14:24:45.591680 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.591576 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982d433c_c140_48f9_b9a8_4368f871e26c.slice/crio-201003959a20295211748faa83783183d36df04db9d6dd504c0591c38f225160 WatchSource:0}: Error finding container 201003959a20295211748faa83783183d36df04db9d6dd504c0591c38f225160: Status 404 returned error can't find the container with id 201003959a20295211748faa83783183d36df04db9d6dd504c0591c38f225160 Jul 06 14:24:45.592519 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.592476 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734711a3_24d4_4b03_9387_3d5ac7faa6b9.slice/crio-3cf04e093d75d97748f1b141f6a8969099c49bb99a187927ac404762b9af0f66 WatchSource:0}: Error finding container 3cf04e093d75d97748f1b141f6a8969099c49bb99a187927ac404762b9af0f66: Status 404 returned error can't find the container with id 3cf04e093d75d97748f1b141f6a8969099c49bb99a187927ac404762b9af0f66 Jul 06 14:24:45.593718 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.593605 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb16fa0_fe34_4e88_8dde_256d20bf35c6.slice/crio-158db8d6948e758eced1bd702b3c983268d1097be1cd4242870cf7eed8370413 WatchSource:0}: Error finding container 158db8d6948e758eced1bd702b3c983268d1097be1cd4242870cf7eed8370413: Status 404 returned error can't find the container with id 158db8d6948e758eced1bd702b3c983268d1097be1cd4242870cf7eed8370413 Jul 06 14:24:45.596114 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.594587 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ba4196_f4d5_466d_be3b_36dfacebd587.slice/crio-214cb6b44910a4db82a936a59db7278cf0a43264c71fe9a855fd84b23ef39fb2 WatchSource:0}: Error finding container 214cb6b44910a4db82a936a59db7278cf0a43264c71fe9a855fd84b23ef39fb2: Status 404 returned error can't find the container with id 214cb6b44910a4db82a936a59db7278cf0a43264c71fe9a855fd84b23ef39fb2 Jul 06 14:24:45.597922 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.597886 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff848a7_2a35_49ce_8f8f_bdf507f316a6.slice/crio-3965d033d084dda7d0a6af19f8527842b92f619cb1a6d4ecc52481d473069b01 WatchSource:0}: Error finding container 3965d033d084dda7d0a6af19f8527842b92f619cb1a6d4ecc52481d473069b01: Status 404 returned error can't find the container with id 3965d033d084dda7d0a6af19f8527842b92f619cb1a6d4ecc52481d473069b01 Jul 06 14:24:45.598272 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:24:45.598148 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a5b689_bc4f_4362_b551_a9eb79e0805d.slice/crio-e2afc238869e6c883b771d953dfb113e313786c61c50dc8afcaf2e4771b7994a WatchSource:0}: Error finding container e2afc238869e6c883b771d953dfb113e313786c61c50dc8afcaf2e4771b7994a: Status 404 returned error can't find the container with id e2afc238869e6c883b771d953dfb113e313786c61c50dc8afcaf2e4771b7994a Jul 06 14:24:45.868110 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.867947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:45.868231 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.868107 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:45.868231 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.868182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:47.868161201 +0000 UTC m=+6.010649814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:45.969342 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:45.969304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:45.969509 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.969478 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:45.969556 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:45.969548 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:47.969530259 +0000 UTC m=+6.112018873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:46.070391 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.070348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:46.070572 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.070543 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:24:46.070572 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.070566 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:24:46.070645 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.070577 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:46.070645 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.070641 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:48.070621363 +0000 UTC m=+6.213109998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:46.313095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.312999 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:19:44 +0000 UTC" deadline="2028-01-24 21:34:05.410420276 +0000 UTC" Jul 06 14:24:46.313095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.313057 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13615h9m19.097367666s" Jul 06 14:24:46.452163 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.452126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:46.452337 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.452276 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:46.452738 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.452714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:46.452869 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:46.452847 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:46.487141 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.487069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" event={"ID":"2fb16fa0-fe34-4e88-8dde-256d20bf35c6","Type":"ContainerStarted","Data":"158db8d6948e758eced1bd702b3c983268d1097be1cd4242870cf7eed8370413"} Jul 06 14:24:46.504165 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.504126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmmpz" event={"ID":"a2ba4196-f4d5-466d-be3b-36dfacebd587","Type":"ContainerStarted","Data":"214cb6b44910a4db82a936a59db7278cf0a43264c71fe9a855fd84b23ef39fb2"} Jul 06 14:24:46.519095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.519007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"201003959a20295211748faa83783183d36df04db9d6dd504c0591c38f225160"} Jul 06 14:24:46.532968 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.532934 2578 generic.go:356] "Generic (PLEG): container finished" podID="753622b084703277fac3a274ae8f2803" containerID="1d9ae80b1ce49377883cf5a381442ac2e1a893e9facf2c75106c6d0dc276598a" exitCode=0 Jul 06 14:24:46.533190 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.533157 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" event={"ID":"753622b084703277fac3a274ae8f2803","Type":"ContainerDied","Data":"1d9ae80b1ce49377883cf5a381442ac2e1a893e9facf2c75106c6d0dc276598a"} Jul 06 14:24:46.540543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.540509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7wqq" event={"ID":"82a5b689-bc4f-4362-b551-a9eb79e0805d","Type":"ContainerStarted","Data":"e2afc238869e6c883b771d953dfb113e313786c61c50dc8afcaf2e4771b7994a"} Jul 06 14:24:46.549038 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.549009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cf4k6" event={"ID":"cff848a7-2a35-49ce-8f8f-bdf507f316a6","Type":"ContainerStarted","Data":"3965d033d084dda7d0a6af19f8527842b92f619cb1a6d4ecc52481d473069b01"} Jul 06 14:24:46.571746 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.571664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" event={"ID":"96cd5eec-0129-4975-a3f3-c3d369923118","Type":"ContainerStarted","Data":"34c80adb3f38e31e6a08c70982a1f6c33356f8982dbb0e730cd88183e31dc730"} Jul 06 14:24:46.583715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.583507 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-snk4k" event={"ID":"734711a3-24d4-4b03-9387-3d5ac7faa6b9","Type":"ContainerStarted","Data":"3cf04e093d75d97748f1b141f6a8969099c49bb99a187927ac404762b9af0f66"} Jul 06 14:24:46.594757 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.594570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerStarted","Data":"31b37d87241fdf4ac1efdc3c7bab20aa4555afe7a70237cafc050b179cf19fd2"} Jul 06 14:24:46.602897 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.602869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jxqkf" event={"ID":"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4","Type":"ContainerStarted","Data":"2408168027be1230c446b872bb734e613a27dc25d8c099220d3bb2a8fe2318cb"} Jul 06 14:24:46.613447 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:46.613418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" event={"ID":"42f9f05fde052bd22d7e2259b719ab44","Type":"ContainerStarted","Data":"cf606fa5428828fe830e4b88cf2386f46b9473a6ad270f5429938c1935eaee4e"} Jul 06 14:24:47.449608 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.449553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:47.450142 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:47.449705 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:47.625646 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.625609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" event={"ID":"753622b084703277fac3a274ae8f2803","Type":"ContainerStarted","Data":"0d0859a16509f70bc33ec5a99b36397e3cdb222262d71eac24b841020163f4dc"} Jul 06 14:24:47.643874 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.643799 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-221.ec2.internal" podStartSLOduration=3.643779687 podStartE2EDuration="3.643779687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:47.643516845 +0000 UTC m=+5.786005513" watchObservedRunningTime="2026-07-06 14:24:47.643779687 +0000 UTC m=+5.786268333" Jul 06 14:24:47.644105 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.644070 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-221.ec2.internal" podStartSLOduration=3.644057062 podStartE2EDuration="3.644057062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:46.632614526 +0000 UTC m=+4.775103164" watchObservedRunningTime="2026-07-06 14:24:47.644057062 +0000 UTC m=+5.786545700" Jul 06 14:24:47.887327 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.887239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:47.887499 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:47.887433 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:47.887499 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:47.887495 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:51.887476599 +0000 UTC m=+10.029965216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:47.988267 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:47.988230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:47.988456 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:47.988404 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:47.988516 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:47.988470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:51.988451049 +0000 UTC m=+10.130939666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:48.089334 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:48.089292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:48.089541 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.089521 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:24:48.089612 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.089550 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:24:48.089612 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.089564 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:48.089716 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.089627 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:52.089607906 +0000 UTC m=+10.232096523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:48.462242 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:48.462174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:48.462766 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.462304 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:48.462766 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:48.462342 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:48.462766 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:48.462423 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:49.449565 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:49.449527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:49.449775 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:49.449658 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:50.451633 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:50.451545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:50.451993 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:50.451664 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:50.451993 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:50.451986 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:50.452066 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:50.452050 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:51.449782 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:51.449744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:51.449934 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:51.449892 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:51.929496 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:51.929465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:51.929926 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:51.929578 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:51.929926 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:51.929636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:24:59.929617231 +0000 UTC m=+18.072105843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:52.030853 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:52.030806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:52.031015 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.030958 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:52.031079 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.031030 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:00.03101021 +0000 UTC m=+18.173498845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:24:52.132008 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:52.131972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:52.132222 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.132199 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:24:52.132294 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.132232 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:24:52.132294 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.132275 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:52.132395 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.132350 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:00.132328573 +0000 UTC m=+18.274817237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:24:52.450503 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:52.450469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:52.450647 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.450563 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:52.450647 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:52.450574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:52.450724 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:52.450695 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:53.449471 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:53.449436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:53.449935 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:53.449576 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:54.449308 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:54.449270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:54.449483 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:54.449406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:54.449923 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:54.449905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:54.450275 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:54.449998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:55.449196 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:55.449166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:55.449387 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:55.449300 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:56.456634 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.456605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:56.456949 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:56.456794 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:56.456949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.456890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:56.457031 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:56.457018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:56.646786 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.646730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" event={"ID":"2fb16fa0-fe34-4e88-8dde-256d20bf35c6","Type":"ContainerStarted","Data":"921ed065ed82e90af6a6d10c3ddc6b8b338da1f13c994d42f712cb538523a00c"} Jul 06 14:24:56.648537 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.648506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7wqq" event={"ID":"82a5b689-bc4f-4362-b551-a9eb79e0805d","Type":"ContainerStarted","Data":"5dc766c681f74c2fb48f0e67fd98450f44ab9d5385dab2c08a3721ba1bafaa20"} Jul 06 14:24:56.651176 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.651144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cf4k6" event={"ID":"cff848a7-2a35-49ce-8f8f-bdf507f316a6","Type":"ContainerStarted","Data":"b15276c3a1ce67d12ba3921b6601f865ec38d41c144f3659c51e41ae52ce0e1e"} Jul 06 14:24:56.653399 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.653370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" event={"ID":"96cd5eec-0129-4975-a3f3-c3d369923118","Type":"ContainerStarted","Data":"01d0b09f62875a36e3da4444f31cc7f35babb01749bae6c1e96d24119c4af677"} Jul 06 14:24:56.654983 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.654958 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="1dd8d1a21c96a85f68be2ddc5329754195ef190f44077a6a0b848e03eec85519" exitCode=0 Jul 06 14:24:56.655096 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.655040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"1dd8d1a21c96a85f68be2ddc5329754195ef190f44077a6a0b848e03eec85519"} Jul 06 14:24:56.657401 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.657375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jxqkf" event={"ID":"cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4","Type":"ContainerStarted","Data":"5544fd2f0fef51834c91cb2d0d73a5f3e706ab084bba9c3020aee8111a8537a9"} Jul 06 14:24:56.666436 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.666386 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7wqq" podStartSLOduration=3.0217658 podStartE2EDuration="13.666370539s" totalImagesPullingTime="10.644604739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:56.665904326 +0000 UTC m=+14.808392955" watchObservedRunningTime="2026-07-06 14:24:56.666370539 +0000 UTC m=+14.808859174" Jul 06 14:24:56.682586 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.682534 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cf4k6" podStartSLOduration=4.044937686 podStartE2EDuration="14.682517406s" totalImagesPullingTime="10.63757972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:56.682089775 +0000 UTC m=+14.824578435" watchObservedRunningTime="2026-07-06 14:24:56.682517406 +0000 UTC m=+14.825006041" Jul 06 14:24:56.725386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.725305 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fcmsj" podStartSLOduration=3.051660821 podStartE2EDuration="13.725291116s" totalImagesPullingTime="10.673630295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:56.724532637 +0000 UTC m=+14.867021272" watchObservedRunningTime="2026-07-06 14:24:56.725291116 +0000 UTC m=+14.867779795" Jul 06 14:24:56.759297 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.759272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:56.827326 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:56.827289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:57.449611 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:57.449582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:57.449801 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:57.449703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:58.449910 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.449875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:58.449910 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.449917 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:24:58.450568 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:58.450020 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:24:58.450568 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:58.450163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:24:58.662981 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.662938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmmpz" event={"ID":"a2ba4196-f4d5-466d-be3b-36dfacebd587","Type":"ContainerStarted","Data":"49d2c465d76105e14dc5cb93e0aee0e4f2673b7971fa0aad02514cf5a06c8415"} Jul 06 14:24:58.678932 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.678885 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jxqkf" podStartSLOduration=5.029891847 podStartE2EDuration="15.678868927s" totalImagesPullingTime="10.64897708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:56.739444392 +0000 UTC m=+14.881933026" watchObservedRunningTime="2026-07-06 14:24:58.678868927 +0000 UTC m=+16.821357596" Jul 06 14:24:58.679112 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.679086 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmmpz" podStartSLOduration=5.028043214 podStartE2EDuration="15.67907952s" totalImagesPullingTime="10.651036306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:58.678760245 +0000 UTC m=+16.821248891" watchObservedRunningTime="2026-07-06 14:24:58.67907952 +0000 UTC m=+16.821568153" Jul 06 14:24:58.805646 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.805552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:58.865538 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:58.865506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:24:59.450039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:59.450009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:24:59.450553 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:59.450133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:24:59.477116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:59.477073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:59.477754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:59.477731 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:24:59.996360 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:24:59.996322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:24:59.996523 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:59.996483 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:24:59.996578 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:24:59.996567 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:15.996545479 +0000 UTC m=+34.139034101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:25:00.097108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:00.097073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:00.097292 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.097227 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:25:00.097346 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.097303 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:16.097282022 +0000 UTC m=+34.239770640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:25:00.197439 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:00.197393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:00.197602 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.197544 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:25:00.197602 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.197568 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:25:00.197602 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.197580 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:25:00.197795 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.197642 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:16.197623008 +0000 UTC m=+34.340111623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:25:00.449617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:00.449576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:00.449809 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:00.449595 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:00.449809 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.449719 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:00.449934 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:00.449810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:01.449081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:01.449050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:01.449662 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:01.449175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:02.453019 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:02.452849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:02.453381 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:02.452900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:02.453381 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:02.453084 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:02.453381 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:02.453173 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:03.449481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:03.449449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:03.449619 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:03.449562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:04.449838 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:04.449809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:04.449838 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:04.449832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:04.450508 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:04.449940 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:04.450508 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:04.450032 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:05.273754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.273717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:05.351090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.351026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:05.449158 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.449133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:05.449306 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:05.449245 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:05.613673 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.613472 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 14:25:05.680277 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.679826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-snk4k" event={"ID":"734711a3-24d4-4b03-9387-3d5ac7faa6b9","Type":"ContainerStarted","Data":"1538332f6421e1e3998612c66bb9284959b797f4bdb427174bbb1ad18c98eae8"} Jul 06 14:25:05.682546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.682518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" event={"ID":"2fb16fa0-fe34-4e88-8dde-256d20bf35c6","Type":"ContainerStarted","Data":"815cfdc66cf5c6918124e801f3c43e8206283b5a3aec3c8c67dbe51efe97a431"} Jul 06 14:25:05.684748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.684725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"d4975c03fe5cc5d5b2fa0306753436458ae161486c203f6d1d52b2425e34abc1"} Jul 06 14:25:05.684885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.684818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"195d8d29a50be468eb06ed3d901f054636f6ef34c9d730d89aa90eeada3f7643"} Jul 06 14:25:05.684885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.684881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"999b9214e61b0b05f7b463a4421b0eaa7ff74232111791131b65bc259779c648"} Jul 06 14:25:05.699724 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.699674 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-snk4k" podStartSLOduration=2.872646277 podStartE2EDuration="22.699660206s" totalImagesPullingTime="19.827013929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:05.69840856 +0000 UTC m=+23.840897195" watchObservedRunningTime="2026-07-06 14:25:05.699660206 +0000 UTC m=+23.842148840" Jul 06 14:25:05.820938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.820914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:05.921574 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:05.921536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:06.319506 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.319383 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:25:05.613670994Z","UUID":"a3c3d265-bd25-4f3e-a95c-4351f1791e0d","Handler":null,"Name":"","Endpoint":""} Jul 06 14:25:06.321052 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.321025 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 14:25:06.321181 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.321070 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 14:25:06.449515 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.449483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:06.449833 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:06.449588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:06.449833 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.449645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:06.449833 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:06.449739 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:06.688996 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.688957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" event={"ID":"2fb16fa0-fe34-4e88-8dde-256d20bf35c6","Type":"ContainerStarted","Data":"1ac06488ab8352c490b77e24b259490469de31a35a809d9230eed60c45fb453a"} Jul 06 14:25:06.691644 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.691619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"8a07de73cf64c728cceba837744749acd8cbe0cea71f0efa337983e8454f006b"} Jul 06 14:25:06.691753 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.691677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"9288f5dcc25f638464e7d2e84538b059845602efdfc58a716e11dddc47f593fa"} Jul 06 14:25:06.691753 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.691708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"265feed7c8d5203d9451f9147f46e68fab4169a27548fa146cbfeb17a1cce1f0"} Jul 06 14:25:06.709879 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:06.709840 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2f4rl" podStartSLOduration=4.11659712 podStartE2EDuration="24.709826227s" totalImagesPullingTime="20.593229107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:06.709681972 +0000 UTC m=+24.852170606" watchObservedRunningTime="2026-07-06 14:25:06.709826227 +0000 UTC m=+24.852314862" Jul 06 14:25:07.449898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:07.449850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:07.450083 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:07.449975 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:08.449841 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:08.449803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:08.450291 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:08.449914 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:08.450291 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:08.449973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:08.450291 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:08.450058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:08.700968 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:08.700885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"198124e09abd03ef7c4950d4e109964ec86aef521f1946b4950075813d863068"} Jul 06 14:25:09.449904 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:09.449864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:09.450277 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:09.449972 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:10.442309 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.442268 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:10.450061 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.450037 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:10.450451 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.450038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:10.450451 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:10.450149 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:10.450451 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:10.450238 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:10.518758 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.518721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:10.642188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.642152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:10.733839 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:10.733749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:11.374723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.374696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:11.449251 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.449229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:11.449355 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:11.449328 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:11.479299 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.479274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:11.711882 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.711685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" event={"ID":"982d433c-c140-48f9-b9a8-4368f871e26c","Type":"ContainerStarted","Data":"b9053790bd1cc347bf00f291002798b1385625fc87a49e7a1e1f4c464c831b25"} Jul 06 14:25:11.712039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.711947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:11.712039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.711983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:11.728734 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.728706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:11.739653 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.739613 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" podStartSLOduration=8.911915151 podStartE2EDuration="28.739601524s" totalImagesPullingTime="19.827686373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:11.738080708 +0000 UTC m=+29.880569359" watchObservedRunningTime="2026-07-06 14:25:11.739601524 +0000 UTC m=+29.882090158" Jul 06 14:25:11.772020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.771992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:11.908563 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:11.908539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:12.450546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.450519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:12.450687 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:12.450598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:12.450687 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.450642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:12.450687 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:12.450685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:12.725947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.725847 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="3047c70df8aad536e6114a6a25dd356fc70a022e250fefc79c37ded13631e785" exitCode=0 Jul 06 14:25:12.726334 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.725943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"3047c70df8aad536e6114a6a25dd356fc70a022e250fefc79c37ded13631e785"} Jul 06 14:25:12.726430 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.726413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:12.746627 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:12.746598 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:13.074960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.074877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:25:13.075125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.075022 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 14:25:13.075441 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.075419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cf4k6" Jul 06 14:25:13.123639 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.123607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:13.195506 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.195480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:13.449601 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.449570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:13.449737 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:13.449693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:13.550420 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.550386 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8lgl"] Jul 06 14:25:13.554255 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.554224 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f9kmf"] Jul 06 14:25:13.554419 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.554287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gmkl8"] Jul 06 14:25:13.554419 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.554369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:13.554519 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:13.554467 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:13.554837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.554818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:13.554951 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:13.554904 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:13.728561 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:13.728535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:13.729013 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:13.728989 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:14.331089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:14.330921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:14.393027 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:14.392988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:14.732700 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:14.732671 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="1c0021f3697602ff40bdacb342f98583bf6c36752c82c95a761ace059c343207" exitCode=0 Jul 06 14:25:14.733171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:14.732805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"1c0021f3697602ff40bdacb342f98583bf6c36752c82c95a761ace059c343207"} Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.449033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.449130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:15.449150 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.449248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:15.449336 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:15.449410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.449399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:15.449886 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:15.449495 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:15.738032 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.737953 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="369d92a91d931781f9b417409d3afee95865a20e52aeca623ccec9dfe018c74e" exitCode=0 Jul 06 14:25:15.738032 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.738001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"369d92a91d931781f9b417409d3afee95865a20e52aeca623ccec9dfe018c74e"} Jul 06 14:25:15.885646 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.885613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:15.989497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:15.989411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:16.015531 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.015495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:16.015701 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.015649 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 14:25:16.015740 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.015712 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret podName:6b0d5885-d8ea-4834-96d2-8fe004010744 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:48.015698703 +0000 UTC m=+66.158187315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret") pod "global-pull-secret-syncer-gmkl8" (UID: "6b0d5885-d8ea-4834-96d2-8fe004010744") : object "kube-system"/"original-pull-secret" not registered Jul 06 14:25:16.116759 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.116726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:16.116970 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.116907 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:25:16.117040 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.116987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs podName:a9f28289-ce6b-4785-9ceb-303843d79744 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:48.116966895 +0000 UTC m=+66.259455532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs") pod "network-metrics-daemon-r8lgl" (UID: "a9f28289-ce6b-4785-9ceb-303843d79744") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 14:25:16.157106 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.157074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:16.217581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.217554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:16.217713 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.217676 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 14:25:16.217713 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.217690 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 14:25:16.217713 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.217700 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6cxzp for pod openshift-network-diagnostics/network-check-target-f9kmf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:25:16.217836 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:16.217747 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp podName:9d4ddb87-83b8-4090-87a7-87a953acd4f6 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:48.217734973 +0000 UTC m=+66.360223586 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cxzp" (UniqueName: "kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp") pod "network-check-target-f9kmf" (UID: "9d4ddb87-83b8-4090-87a7-87a953acd4f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 14:25:16.261803 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.261705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:16.988708 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:16.988676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:17.094197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.094161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:17.189275 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.189239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:17.449228 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.449156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:17.449371 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.449156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:17.449371 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:17.449256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8lgl" podUID="a9f28289-ce6b-4785-9ceb-303843d79744" Jul 06 14:25:17.449371 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.449156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:17.449371 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:17.449332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gmkl8" podUID="6b0d5885-d8ea-4834-96d2-8fe004010744" Jul 06 14:25:17.449525 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:17.449391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f9kmf" podUID="9d4ddb87-83b8-4090-87a7-87a953acd4f6" Jul 06 14:25:17.793424 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.793334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:17.891623 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:17.891579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:18.679245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:18.679201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:19.171427 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.171399 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-221.ec2.internal" event="NodeReady" Jul 06 14:25:19.171599 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.171545 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 14:25:19.289123 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.289090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:19.347955 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.347915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:19.449981 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.449900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:19.450138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.449909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:19.450138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.449909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:19.452860 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.452824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:25:19.454130 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.454107 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:25:19.454398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.454377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fzm8z\"" Jul 06 14:25:19.454572 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.454556 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:25:19.454966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.454798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:25:19.454966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.454919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-689l7\"" Jul 06 14:25:19.667938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:19.667912 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jxqkf_cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4/dns-node-resolver/0.log" Jul 06 14:25:20.266293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.266264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7wqq_82a5b689-bc4f-4362-b551-a9eb79e0805d/node-ca/0.log" Jul 06 14:25:20.342723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.342685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:20.442647 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.442609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:20.545604 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.545494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:20.647820 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.647786 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:20.747695 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.747670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:20.845759 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:20.845673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:21.030176 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:21.030131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:21.514311 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:21.514278 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:21.756438 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:21.756408 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="7f8fae89179c4413acf7f57d696ace1ed29a2d2bad6b3f68c59bff4f7ad49ea7" exitCode=0 Jul 06 14:25:21.756611 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:21.756463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"7f8fae89179c4413acf7f57d696ace1ed29a2d2bad6b3f68c59bff4f7ad49ea7"} Jul 06 14:25:22.032391 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.032356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:22.426821 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.426790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:22.639786 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.639739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:22.761192 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.760956 2578 generic.go:356] "Generic (PLEG): container finished" podID="e95d2ec3-f43a-4102-af41-0754a3e2711d" containerID="36b3c98f81fae99a12301d28a03085cac8aa62e5ca830b55e5cf880129b46011" exitCode=0 Jul 06 14:25:22.761192 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.761029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerDied","Data":"36b3c98f81fae99a12301d28a03085cac8aa62e5ca830b55e5cf880129b46011"} Jul 06 14:25:22.836383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:22.836348 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:23.230737 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:23.230705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:23.632333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:23.632295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:23.766477 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:23.766444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hg98v" event={"ID":"e95d2ec3-f43a-4102-af41-0754a3e2711d","Type":"ContainerStarted","Data":"6454f42534da6e5052f9023495534c69f2e7efa27e2e2352f3bb1f4c87990750"} Jul 06 14:25:23.795105 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:23.795057 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hg98v" podStartSLOduration=7.557687184 podStartE2EDuration="40.795042962s" totalImagesPullingTime="33.237355778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:23.793465364 +0000 UTC m=+41.935953998" watchObservedRunningTime="2026-07-06 14:25:23.795042962 +0000 UTC m=+41.937531662" Jul 06 14:25:24.040975 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:24.040940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:24.241365 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:24.241333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:24.341388 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:24.341310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:24.838343 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:24.838307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.035742 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:25.035709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.135310 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:25.135225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.236401 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:25.236372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:25.641332 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:25.641298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.032955 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:26.032924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:26.639683 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:26.639654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:27.062122 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:27.062092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:27.241537 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:27.241502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:27.442450 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:27.442421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:27.833432 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:27.833351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:28.042734 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:28.042612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:28.435191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:28.435156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.042465 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.042433 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.144340 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.144308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.340462 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.340388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.441197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.441162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.650546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.650461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:29.852431 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:29.852399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.043997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:30.043966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.249993 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:30.249954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.430699 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:30.430670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:30.830829 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:30.830746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:31.031183 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:31.031154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:37.581457 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.581418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:37.620166 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.620139 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6dqgb"] Jul 06 14:25:37.643472 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.643439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dqgb"] Jul 06 14:25:37.643597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.643532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.647002 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.646578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 14:25:37.647002 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.646853 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 14:25:37.647204 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.647094 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 14:25:37.647204 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.647112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 14:25:37.647804 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.647785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6mh8w\"" Jul 06 14:25:37.651879 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.651554 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bp6nf"] Jul 06 14:25:37.669358 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.669338 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mr4gm"] Jul 06 14:25:37.669505 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.669487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.672390 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.672373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 14:25:37.672390 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.672380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 14:25:37.673170 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.673149 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xqgrr\"" Jul 06 14:25:37.673429 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.673349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 14:25:37.679752 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7tz\" (UniqueName: \"kubernetes.io/projected/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-kube-api-access-vl7tz\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.679837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98942fc4-9280-4b3e-8617-62d15605aa6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.679837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4f7b\" (UniqueName: \"kubernetes.io/projected/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-api-access-x4f7b\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.679911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98942fc4-9280-4b3e-8617-62d15605aa6c-data-volume\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.679911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-cert\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.679911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98942fc4-9280-4b3e-8617-62d15605aa6c-crio-socket\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.680000 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.679911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.689562 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.689541 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bp6nf"] Jul 06 14:25:37.689645 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.689567 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mr4gm"] Jul 06 14:25:37.689689 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.689647 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.691479 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.691440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:37.692312 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.692297 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s54bc\"" Jul 06 14:25:37.692430 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.692415 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 14:25:37.692497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.692481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 14:25:37.780877 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.780846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7tz\" (UniqueName: \"kubernetes.io/projected/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-kube-api-access-vl7tz\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.780877 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.780883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98942fc4-9280-4b3e-8617-62d15605aa6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.780908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4f7b\" (UniqueName: \"kubernetes.io/projected/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-api-access-x4f7b\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.780963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c323ed90-d9f4-41b5-bab8-025bc682feef-tmp-dir\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.781095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c323ed90-d9f4-41b5-bab8-025bc682feef-config-volume\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.781095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98942fc4-9280-4b3e-8617-62d15605aa6c-data-volume\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781095 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c323ed90-d9f4-41b5-bab8-025bc682feef-metrics-tls\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.781330 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hddq\" (UniqueName: \"kubernetes.io/projected/c323ed90-d9f4-41b5-bab8-025bc682feef-kube-api-access-6hddq\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.781330 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-cert\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.781330 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98942fc4-9280-4b3e-8617-62d15605aa6c-crio-socket\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781330 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98942fc4-9280-4b3e-8617-62d15605aa6c-crio-socket\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98942fc4-9280-4b3e-8617-62d15605aa6c-data-volume\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.781748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.781732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.784745 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.784713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98942fc4-9280-4b3e-8617-62d15605aa6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.784972 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.784955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-cert\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.797062 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.797035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7tz\" (UniqueName: \"kubernetes.io/projected/28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6-kube-api-access-vl7tz\") pod \"ingress-canary-bp6nf\" (UID: \"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6\") " pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.797210 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.797193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4f7b\" (UniqueName: \"kubernetes.io/projected/98942fc4-9280-4b3e-8617-62d15605aa6c-kube-api-access-x4f7b\") pod \"insights-runtime-extractor-6dqgb\" (UID: \"98942fc4-9280-4b3e-8617-62d15605aa6c\") " pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.799820 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.799799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:37.881696 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.881608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c323ed90-d9f4-41b5-bab8-025bc682feef-tmp-dir\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.881696 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.881641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c323ed90-d9f4-41b5-bab8-025bc682feef-config-volume\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.881696 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.881664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c323ed90-d9f4-41b5-bab8-025bc682feef-metrics-tls\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.881984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.881838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hddq\" (UniqueName: \"kubernetes.io/projected/c323ed90-d9f4-41b5-bab8-025bc682feef-kube-api-access-6hddq\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.882069 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.882048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c323ed90-d9f4-41b5-bab8-025bc682feef-tmp-dir\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.882245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.882213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c323ed90-d9f4-41b5-bab8-025bc682feef-config-volume\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.884119 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.884091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c323ed90-d9f4-41b5-bab8-025bc682feef-metrics-tls\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.890830 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.890811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hddq\" (UniqueName: \"kubernetes.io/projected/c323ed90-d9f4-41b5-bab8-025bc682feef-kube-api-access-6hddq\") pod \"dns-default-mr4gm\" (UID: \"c323ed90-d9f4-41b5-bab8-025bc682feef\") " pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:37.903865 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.903839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:37.953822 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.953792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6dqgb" Jul 06 14:25:37.977898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.977876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bp6nf" Jul 06 14:25:37.997556 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:37.997533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:38.194821 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.194793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mr4gm"] Jul 06 14:25:38.198873 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:38.198846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc323ed90_d9f4_41b5_bab8_025bc682feef.slice/crio-425d2bb878676bd55b09f2b06304fd1ddc2cba739d7f1e451ab652e13542ad44 WatchSource:0}: Error finding container 425d2bb878676bd55b09f2b06304fd1ddc2cba739d7f1e451ab652e13542ad44: Status 404 returned error can't find the container with id 425d2bb878676bd55b09f2b06304fd1ddc2cba739d7f1e451ab652e13542ad44 Jul 06 14:25:38.225300 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.225274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:38.326444 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.326405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:38.403359 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.403287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bp6nf"] Jul 06 14:25:38.406510 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.406488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6dqgb"] Jul 06 14:25:38.417538 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:38.417504 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cb5cdd_06e8_4eaa_8d3d_d85c987d35e6.slice/crio-2f94e1062b917ae19c3e0006db2d5b106709632ab71627fbf26bf6bbb1c8a5a9 WatchSource:0}: Error finding container 2f94e1062b917ae19c3e0006db2d5b106709632ab71627fbf26bf6bbb1c8a5a9: Status 404 returned error can't find the container with id 2f94e1062b917ae19c3e0006db2d5b106709632ab71627fbf26bf6bbb1c8a5a9 Jul 06 14:25:38.418149 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:38.418124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98942fc4_9280_4b3e_8617_62d15605aa6c.slice/crio-fb81196399d90cf668faba52e660e1096695aa4f069e4eb6c375e1dccf25d47d WatchSource:0}: Error finding container fb81196399d90cf668faba52e660e1096695aa4f069e4eb6c375e1dccf25d47d: Status 404 returned error can't find the container with id fb81196399d90cf668faba52e660e1096695aa4f069e4eb6c375e1dccf25d47d Jul 06 14:25:38.802361 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.802320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bp6nf" event={"ID":"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6","Type":"ContainerStarted","Data":"2f94e1062b917ae19c3e0006db2d5b106709632ab71627fbf26bf6bbb1c8a5a9"} Jul 06 14:25:38.803544 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.803517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr4gm" event={"ID":"c323ed90-d9f4-41b5-bab8-025bc682feef","Type":"ContainerStarted","Data":"425d2bb878676bd55b09f2b06304fd1ddc2cba739d7f1e451ab652e13542ad44"} Jul 06 14:25:38.804658 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:38.804635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dqgb" event={"ID":"98942fc4-9280-4b3e-8617-62d15605aa6c","Type":"ContainerStarted","Data":"fb81196399d90cf668faba52e660e1096695aa4f069e4eb6c375e1dccf25d47d"} Jul 06 14:25:43.821099 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.821005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dqgb" event={"ID":"98942fc4-9280-4b3e-8617-62d15605aa6c","Type":"ContainerStarted","Data":"8978a1282848ea82aba7d027075089b0ed2dc361070c7b1882e6f8a9748c51b8"} Jul 06 14:25:43.822711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.822681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bp6nf" event={"ID":"28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6","Type":"ContainerStarted","Data":"35cd02b2e28b4a5dcb8d59958a28f2b09547231ec47a61b04bd5d8ab07edbda0"} Jul 06 14:25:43.824514 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.824494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr4gm" event={"ID":"c323ed90-d9f4-41b5-bab8-025bc682feef","Type":"ContainerStarted","Data":"7cddce0017355bf241c9598e6d35e951d873b160a5c5145150345034737db9d2"} Jul 06 14:25:43.824617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.824529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mr4gm" event={"ID":"c323ed90-d9f4-41b5-bab8-025bc682feef","Type":"ContainerStarted","Data":"8bbfef5ec44b9ab760bb8effc5594298040ee72a834114e38cc171d1d6ce80f0"} Jul 06 14:25:43.824654 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.824640 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:43.868024 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.867973 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bp6nf" podStartSLOduration=1.7899662969999999 podStartE2EDuration="6.867956961s" totalImagesPullingTime="5.077990664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:43.843085754 +0000 UTC m=+61.985574387" watchObservedRunningTime="2026-07-06 14:25:43.867956961 +0000 UTC m=+62.010445572" Jul 06 14:25:43.868288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:43.868261 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mr4gm" podStartSLOduration=1.593380767 podStartE2EDuration="6.868249693s" totalImagesPullingTime="5.274868926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:43.867306839 +0000 UTC m=+62.009795474" watchObservedRunningTime="2026-07-06 14:25:43.868249693 +0000 UTC m=+62.010738338" Jul 06 14:25:44.744611 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.744581 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j4kxx" Jul 06 14:25:44.756400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.756354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:44.829858 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.829824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dqgb" event={"ID":"98942fc4-9280-4b3e-8617-62d15605aa6c","Type":"ContainerStarted","Data":"483513f63e233a061ee5e628db8d53454b39fa2d86f178fd8ba12dc6134a3326"} Jul 06 14:25:44.856315 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.856282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:44.933152 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.933117 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw"] Jul 06 14:25:44.938799 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.938750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:44.941322 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.941302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 14:25:44.941450 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.941345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xzw9k\"" Jul 06 14:25:44.945437 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.945413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw"] Jul 06 14:25:44.953443 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:44.953419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:45.041136 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.041045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z4hbw\" (UID: \"875c4f62-e239-4376-994e-9da7f194ebd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:45.097298 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.097263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:45.141901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.141867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z4hbw\" (UID: \"875c4f62-e239-4376-994e-9da7f194ebd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:45.142088 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:45.142028 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 14:25:45.142137 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:45.142096 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates podName:875c4f62-e239-4376-994e-9da7f194ebd8 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:45.642079888 +0000 UTC m=+63.784568499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-z4hbw" (UID: "875c4f62-e239-4376-994e-9da7f194ebd8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 14:25:45.197504 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.197440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:45.259643 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.259607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:45.645957 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.645915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z4hbw\" (UID: \"875c4f62-e239-4376-994e-9da7f194ebd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:45.648824 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.648794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/875c4f62-e239-4376-994e-9da7f194ebd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-z4hbw\" (UID: \"875c4f62-e239-4376-994e-9da7f194ebd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:45.849699 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:45.849668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:46.762594 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:46.762562 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw"] Jul 06 14:25:46.766061 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:46.766031 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875c4f62_e239_4376_994e_9da7f194ebd8.slice/crio-c01c8d087df0ad8ae10a346b58f25200008abab214b5959be248ba2251859cbf WatchSource:0}: Error finding container c01c8d087df0ad8ae10a346b58f25200008abab214b5959be248ba2251859cbf: Status 404 returned error can't find the container with id c01c8d087df0ad8ae10a346b58f25200008abab214b5959be248ba2251859cbf Jul 06 14:25:46.836707 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:46.836673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" event={"ID":"875c4f62-e239-4376-994e-9da7f194ebd8","Type":"ContainerStarted","Data":"c01c8d087df0ad8ae10a346b58f25200008abab214b5959be248ba2251859cbf"} Jul 06 14:25:46.838674 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:46.838647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6dqgb" event={"ID":"98942fc4-9280-4b3e-8617-62d15605aa6c","Type":"ContainerStarted","Data":"4feee79a9433fd14a344124a94074c78af5e8b9f4264b0581de9c2be7426e11b"} Jul 06 14:25:46.857341 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:46.857300 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6dqgb" podStartSLOduration=1.760875665 podStartE2EDuration="9.857285295s" totalImagesPullingTime="8.09640963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:25:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:46.856692753 +0000 UTC m=+64.999181411" watchObservedRunningTime="2026-07-06 14:25:46.857285295 +0000 UTC m=+64.999773928" Jul 06 14:25:48.063890 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.063853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:48.066954 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.066931 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 14:25:48.076683 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.076655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b0d5885-d8ea-4834-96d2-8fe004010744-original-pull-secret\") pod \"global-pull-secret-syncer-gmkl8\" (UID: \"6b0d5885-d8ea-4834-96d2-8fe004010744\") " pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:48.165031 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.164988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:48.167820 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.167803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 14:25:48.177590 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.177560 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9f28289-ce6b-4785-9ceb-303843d79744-metrics-certs\") pod \"network-metrics-daemon-r8lgl\" (UID: \"a9f28289-ce6b-4785-9ceb-303843d79744\") " pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:48.264583 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.264503 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-689l7\"" Jul 06 14:25:48.265683 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.265665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:48.268038 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.268020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gmkl8" Jul 06 14:25:48.268102 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.268059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 14:25:48.272184 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.272166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8lgl" Jul 06 14:25:48.278836 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.278627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 14:25:48.290834 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.290454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxzp\" (UniqueName: \"kubernetes.io/projected/9d4ddb87-83b8-4090-87a7-87a953acd4f6-kube-api-access-6cxzp\") pod \"network-check-target-f9kmf\" (UID: \"9d4ddb87-83b8-4090-87a7-87a953acd4f6\") " pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:48.397855 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.397607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gmkl8"] Jul 06 14:25:48.400230 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:48.400204 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0d5885_d8ea_4834_96d2_8fe004010744.slice/crio-75e8bd29daeeb85b80f16b1ba9cd649f4de278855d5f303bbdcb98147b083863 WatchSource:0}: Error finding container 75e8bd29daeeb85b80f16b1ba9cd649f4de278855d5f303bbdcb98147b083863: Status 404 returned error can't find the container with id 75e8bd29daeeb85b80f16b1ba9cd649f4de278855d5f303bbdcb98147b083863 Jul 06 14:25:48.411152 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.411127 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8lgl"] Jul 06 14:25:48.413708 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:48.413680 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f28289_ce6b_4785_9ceb_303843d79744.slice/crio-27d201440c76795b885fd50378aebe5e3966ee4ed098a320e3a082c520d57978 WatchSource:0}: Error finding container 27d201440c76795b885fd50378aebe5e3966ee4ed098a320e3a082c520d57978: Status 404 returned error can't find the container with id 27d201440c76795b885fd50378aebe5e3966ee4ed098a320e3a082c520d57978 Jul 06 14:25:48.576787 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.576689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fzm8z\"" Jul 06 14:25:48.585047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.585026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:48.703617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.703520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f9kmf"] Jul 06 14:25:48.706955 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:48.706931 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4ddb87_83b8_4090_87a7_87a953acd4f6.slice/crio-2e6db58e89c97d0f3d334da8d900adbb16a107840e9c6206fd3b2ca0b560e612 WatchSource:0}: Error finding container 2e6db58e89c97d0f3d334da8d900adbb16a107840e9c6206fd3b2ca0b560e612: Status 404 returned error can't find the container with id 2e6db58e89c97d0f3d334da8d900adbb16a107840e9c6206fd3b2ca0b560e612 Jul 06 14:25:48.846688 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.846601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" event={"ID":"875c4f62-e239-4376-994e-9da7f194ebd8","Type":"ContainerStarted","Data":"6e7e6d71efe4cdcbaa0af8afefd2a6dea6f90fcdb4999cdef221c4058a8577cf"} Jul 06 14:25:48.846888 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.846756 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:48.847908 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.847882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gmkl8" event={"ID":"6b0d5885-d8ea-4834-96d2-8fe004010744","Type":"ContainerStarted","Data":"75e8bd29daeeb85b80f16b1ba9cd649f4de278855d5f303bbdcb98147b083863"} Jul 06 14:25:48.849065 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.849035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f9kmf" event={"ID":"9d4ddb87-83b8-4090-87a7-87a953acd4f6","Type":"ContainerStarted","Data":"2e6db58e89c97d0f3d334da8d900adbb16a107840e9c6206fd3b2ca0b560e612"} Jul 06 14:25:48.850203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.850180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8lgl" event={"ID":"a9f28289-ce6b-4785-9ceb-303843d79744","Type":"ContainerStarted","Data":"27d201440c76795b885fd50378aebe5e3966ee4ed098a320e3a082c520d57978"} Jul 06 14:25:48.852023 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.852003 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" Jul 06 14:25:48.863293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.863253 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-z4hbw" podStartSLOduration=3.692937407 podStartE2EDuration="4.863239526s" totalImagesPullingTime="1.170302119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:48.862683694 +0000 UTC m=+67.005172520" watchObservedRunningTime="2026-07-06 14:25:48.863239526 +0000 UTC m=+67.005728160" Jul 06 14:25:48.956647 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:48.956609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:49.010213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.010185 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt"] Jul 06 14:25:49.012383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.012360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.015523 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 14:25:49.015642 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015527 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 14:25:49.015642 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015547 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 14:25:49.015896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qgf2p\"" Jul 06 14:25:49.015896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 14:25:49.016118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.015953 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 14:25:49.023438 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.023412 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt"] Jul 06 14:25:49.042265 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.042229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:49.070543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.070499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.070543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.070536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa73771-abfd-4f4c-875e-e915e99d9326-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.070976 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.070569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6t66\" (UniqueName: \"kubernetes.io/projected/2aa73771-abfd-4f4c-875e-e915e99d9326-kube-api-access-p6t66\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.070976 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.070663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.171702 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.171666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.171915 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.171723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.171915 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:49.171869 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 14:25:49.172041 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:49.171936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls podName:2aa73771-abfd-4f4c-875e-e915e99d9326 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:49.67191407 +0000 UTC m=+67.814402685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-qt6pt" (UID: "2aa73771-abfd-4f4c-875e-e915e99d9326") : secret "prometheus-operator-tls" not found Jul 06 14:25:49.172041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.171987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa73771-abfd-4f4c-875e-e915e99d9326-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.172157 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.172076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6t66\" (UniqueName: \"kubernetes.io/projected/2aa73771-abfd-4f4c-875e-e915e99d9326-kube-api-access-p6t66\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.172827 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.172805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2aa73771-abfd-4f4c-875e-e915e99d9326-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.174827 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.174759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.181716 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.181691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6t66\" (UniqueName: \"kubernetes.io/projected/2aa73771-abfd-4f4c-875e-e915e99d9326-kube-api-access-p6t66\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.305973 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.305899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:49.677566 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.677062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.681349 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.681292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2aa73771-abfd-4f4c-875e-e915e99d9326-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-qt6pt\" (UID: \"2aa73771-abfd-4f4c-875e-e915e99d9326\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:49.924593 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:49.924572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" Jul 06 14:25:50.078272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.078234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt"] Jul 06 14:25:50.083477 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:50.083437 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa73771_abfd_4f4c_875e_e915e99d9326.slice/crio-8dabb1b70af4763b07369ea41e0089d86a2d2101aaaafe501f8c52f3a80d8e66 WatchSource:0}: Error finding container 8dabb1b70af4763b07369ea41e0089d86a2d2101aaaafe501f8c52f3a80d8e66: Status 404 returned error can't find the container with id 8dabb1b70af4763b07369ea41e0089d86a2d2101aaaafe501f8c52f3a80d8e66 Jul 06 14:25:50.863724 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.863638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" event={"ID":"2aa73771-abfd-4f4c-875e-e915e99d9326","Type":"ContainerStarted","Data":"8dabb1b70af4763b07369ea41e0089d86a2d2101aaaafe501f8c52f3a80d8e66"} Jul 06 14:25:50.867120 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.867084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8lgl" event={"ID":"a9f28289-ce6b-4785-9ceb-303843d79744","Type":"ContainerStarted","Data":"16bf4d03b999085bf728650486c7ac64dd00d5241f88f367fcdf2ff8d26b43b6"} Jul 06 14:25:50.867261 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.867141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8lgl" event={"ID":"a9f28289-ce6b-4785-9ceb-303843d79744","Type":"ContainerStarted","Data":"75c9f7217c3902422047478e4313d5d1ccc1defe81db0e1b143eb219c8a1fb12"} Jul 06 14:25:50.885905 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.884861 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8lgl" podStartSLOduration=66.480453202 podStartE2EDuration="1m7.884833566s" totalImagesPullingTime="1.404380364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:50.884557454 +0000 UTC m=+69.027046089" watchObservedRunningTime="2026-07-06 14:25:50.884833566 +0000 UTC m=+69.027322203" Jul 06 14:25:50.976550 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:50.976514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:51.073796 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:51.073728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:51.132606 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:51.132510 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:51.841671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:51.841637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:51.943485 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:51.943450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:53.246665 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:53.246634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:53.330588 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:53.330557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:53.832661 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:53.832632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mr4gm" Jul 06 14:25:54.163543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.163517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:54.792014 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.791981 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-mtn2l"] Jul 06 14:25:54.794071 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.794046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:25:54.796556 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.796534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 14:25:54.796687 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.796535 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mqtcg\"" Jul 06 14:25:54.796845 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.796831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 14:25:54.809635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.809605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69c7\" (UniqueName: \"kubernetes.io/projected/d2ecd67a-0d65-4ebd-ba68-836b66c4011d-kube-api-access-s69c7\") pod \"downloads-685bfb5f64-mtn2l\" (UID: \"d2ecd67a-0d65-4ebd-ba68-836b66c4011d\") " pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:25:54.810360 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.810337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-mtn2l"] Jul 06 14:25:54.820366 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.820341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:54.888182 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.888151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gmkl8" event={"ID":"6b0d5885-d8ea-4834-96d2-8fe004010744","Type":"ContainerStarted","Data":"8a643b8ed208e8ddae2df34826621a7c9b324e96563465831cd36eccb7957ac1"} Jul 06 14:25:54.890217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.890181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" event={"ID":"2aa73771-abfd-4f4c-875e-e915e99d9326","Type":"ContainerStarted","Data":"6d1a91b64e7faf8e300903631e7a850fa036cd17fae7dc95eb78e102cb0f5142"} Jul 06 14:25:54.890366 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.890242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" event={"ID":"2aa73771-abfd-4f4c-875e-e915e99d9326","Type":"ContainerStarted","Data":"d2d4ec0bfb8aa925ea447cd83aeb1712bbf7d6ccc6ebe460e2f96765d6bb0216"} Jul 06 14:25:54.891682 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.891654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f9kmf" event={"ID":"9d4ddb87-83b8-4090-87a7-87a953acd4f6","Type":"ContainerStarted","Data":"a0ed803f848152f81aa5ebe703bb156cdae8b83baf8c01c2c144eac9814a2c92"} Jul 06 14:25:54.891823 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.891809 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:25:54.910444 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.910407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s69c7\" (UniqueName: \"kubernetes.io/projected/d2ecd67a-0d65-4ebd-ba68-836b66c4011d-kube-api-access-s69c7\") pod \"downloads-685bfb5f64-mtn2l\" (UID: \"d2ecd67a-0d65-4ebd-ba68-836b66c4011d\") " pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:25:54.916509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.916461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:54.919514 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.919488 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69c7\" (UniqueName: \"kubernetes.io/projected/d2ecd67a-0d65-4ebd-ba68-836b66c4011d-kube-api-access-s69c7\") pod \"downloads-685bfb5f64-mtn2l\" (UID: \"d2ecd67a-0d65-4ebd-ba68-836b66c4011d\") " pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:25:54.927232 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.927175 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gmkl8" podStartSLOduration=66.513445942 podStartE2EDuration="1m11.927155331s" totalImagesPullingTime="5.413709389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:54.905173834 +0000 UTC m=+73.047662467" watchObservedRunningTime="2026-07-06 14:25:54.927155331 +0000 UTC m=+73.069643965" Jul 06 14:25:54.927560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.927513 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f9kmf" podStartSLOduration=66.835778415 podStartE2EDuration="1m11.927499562s" totalImagesPullingTime="5.091721147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:54.927454987 +0000 UTC m=+73.069943599" watchObservedRunningTime="2026-07-06 14:25:54.927499562 +0000 UTC m=+73.069988197" Jul 06 14:25:54.943679 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.943624 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-qt6pt" podStartSLOduration=3.22806869 podStartE2EDuration="6.943606012s" totalImagesPullingTime="3.715537322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:54.943483093 +0000 UTC m=+73.085971729" watchObservedRunningTime="2026-07-06 14:25:54.943606012 +0000 UTC m=+73.086094659" Jul 06 14:25:54.982719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:54.982682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.085402 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.085318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.103418 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.103395 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:25:55.232932 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.232909 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-mtn2l"] Jul 06 14:25:55.235132 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:55.235106 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ecd67a_0d65_4ebd_ba68_836b66c4011d.slice/crio-ff27ba269f8b898ff526d4074dd241d0682e981dd51954239b936b537f803eed WatchSource:0}: Error finding container ff27ba269f8b898ff526d4074dd241d0682e981dd51954239b936b537f803eed: Status 404 returned error can't find the container with id ff27ba269f8b898ff526d4074dd241d0682e981dd51954239b936b537f803eed Jul 06 14:25:55.263226 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.263204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.363908 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.363824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.464801 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.464749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.566303 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.566270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.670089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.670031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.771256 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.771225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:55.896080 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:55.896046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-mtn2l" event={"ID":"d2ecd67a-0d65-4ebd-ba68-836b66c4011d","Type":"ContainerStarted","Data":"ff27ba269f8b898ff526d4074dd241d0682e981dd51954239b936b537f803eed"} Jul 06 14:25:56.126009 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.125924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.346449 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.346420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.400702 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.400624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz"] Jul 06 14:25:56.403452 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.403432 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.406584 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.406562 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-25c9q\"" Jul 06 14:25:56.406709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.406616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 14:25:56.407166 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.407149 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 14:25:56.424089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.424067 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz"] Jul 06 14:25:56.424293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.424266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.424399 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.424324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.424399 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.424375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.424515 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.424453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6fn\" (UniqueName: \"kubernetes.io/projected/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-kube-api-access-5m6fn\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.442709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.442673 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v8jp5"] Jul 06 14:25:56.445244 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.445213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.448806 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.448745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 14:25:56.449188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.449171 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 14:25:56.449290 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.449198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5g2jr\"" Jul 06 14:25:56.449709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.449688 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 14:25:56.449803 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.449750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.458372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.458346 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789"] Jul 06 14:25:56.460912 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.460892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.465540 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.465517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d6bf6\"" Jul 06 14:25:56.465630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.465573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 14:25:56.466748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.466724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 14:25:56.467807 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.467786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 14:25:56.477976 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.477954 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789"] Jul 06 14:25:56.524984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.524956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.525149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.524993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-wtmp\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.525149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6fn\" (UniqueName: \"kubernetes.io/projected/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-kube-api-access-5m6fn\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.525149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-root\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-textfile\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzll\" (UniqueName: \"kubernetes.io/projected/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-kube-api-access-qlzll\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.525230 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13fc8be2-0285-4c47-9049-f06174392068-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.525400 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.525299 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls podName:e5777ff9-44b0-4ff4-b79c-0ec496e461dc nodeName:}" failed. No retries permitted until 2026-07-06 14:25:57.025274967 +0000 UTC m=+75.167763599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-frmpz" (UID: "e5777ff9-44b0-4ff4-b79c-0ec496e461dc") : secret "openshift-state-metrics-tls" not found Jul 06 14:25:56.525671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.525671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kccr\" (UniqueName: \"kubernetes.io/projected/13fc8be2-0285-4c47-9049-f06174392068-kube-api-access-5kccr\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.525671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.525671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-metrics-client-ca\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.525896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-sys\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.525896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.525836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.526327 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.526306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.528096 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.528076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.539369 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.539333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6fn\" (UniqueName: \"kubernetes.io/projected/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-kube-api-access-5m6fn\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:56.540411 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.540384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.627325 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.627500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-sys\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.627495 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.627512 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-wtmp\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-root\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.627689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls podName:8daa4865-ff66-4ae5-b07c-15eeaa46ef5b nodeName:}" failed. No retries permitted until 2026-07-06 14:25:57.127654944 +0000 UTC m=+75.270143570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls") pod "node-exporter-v8jp5" (UID: "8daa4865-ff66-4ae5-b07c-15eeaa46ef5b") : secret "node-exporter-tls" not found Jul 06 14:25:56.627710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627704 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-root\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627991 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-textfile\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.627991 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:56.627753 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls podName:13fc8be2-0285-4c47-9049-f06174392068 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:57.127739121 +0000 UTC m=+75.270227734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-vt789" (UID: "13fc8be2-0285-4c47-9049-f06174392068") : secret "kube-state-metrics-tls" not found Jul 06 14:25:56.627991 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.627759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-sys\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.628410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.628385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-wtmp\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.628909 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.628880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-textfile\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.629427 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.629516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzll\" (UniqueName: \"kubernetes.io/projected/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-kube-api-access-qlzll\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.629569 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.629625 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13fc8be2-0285-4c47-9049-f06174392068-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.629678 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.629678 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.629793 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kccr\" (UniqueName: \"kubernetes.io/projected/13fc8be2-0285-4c47-9049-f06174392068-kube-api-access-5kccr\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.629849 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.629788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-metrics-client-ca\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.631329 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.631187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-metrics-client-ca\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.636412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.633921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13fc8be2-0285-4c47-9049-f06174392068-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.636412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.634690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.636917 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.636888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.639070 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.639045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.645209 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.645181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.646219 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.646197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kccr\" (UniqueName: \"kubernetes.io/projected/13fc8be2-0285-4c47-9049-f06174392068-kube-api-access-5kccr\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:56.646548 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.646529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzll\" (UniqueName: \"kubernetes.io/projected/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-kube-api-access-qlzll\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:56.743410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.743375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.841137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.841102 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:56.941339 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:56.941306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.033913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.033825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:57.034057 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:57.033987 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 14:25:57.034100 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:57.034063 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls podName:e5777ff9-44b0-4ff4-b79c-0ec496e461dc nodeName:}" failed. No retries permitted until 2026-07-06 14:25:58.034040999 +0000 UTC m=+76.176529639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-frmpz" (UID: "e5777ff9-44b0-4ff4-b79c-0ec496e461dc") : secret "openshift-state-metrics-tls" not found Jul 06 14:25:57.041932 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.041886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.134835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.134757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:57.134835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.134844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:57.137809 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.137787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8daa4865-ff66-4ae5-b07c-15eeaa46ef5b-node-exporter-tls\") pod \"node-exporter-v8jp5\" (UID: \"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b\") " pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:57.137951 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.137928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13fc8be2-0285-4c47-9049-f06174392068-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-vt789\" (UID: \"13fc8be2-0285-4c47-9049-f06174392068\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:57.346222 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.346116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.357316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.357289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8jp5" Jul 06 14:25:57.368595 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:57.368566 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daa4865_ff66_4ae5_b07c_15eeaa46ef5b.slice/crio-dc5bff25cfbb38ed14ae81a7786b25489226bb5ae98ccabfdf590b270933d08c WatchSource:0}: Error finding container dc5bff25cfbb38ed14ae81a7786b25489226bb5ae98ccabfdf590b270933d08c: Status 404 returned error can't find the container with id dc5bff25cfbb38ed14ae81a7786b25489226bb5ae98ccabfdf590b270933d08c Jul 06 14:25:57.371894 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.371844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" Jul 06 14:25:57.452709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.452675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.477638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.477604 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:25:57.480736 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.480716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.483221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.483198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 14:25:57.483338 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.483200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 14:25:57.483565 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.483546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 14:25:57.483715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.483697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 14:25:57.483873 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.483856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 14:25:57.484030 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.484012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 14:25:57.484110 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.484080 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-klpmj\"" Jul 06 14:25:57.484186 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.484082 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 14:25:57.484240 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.484188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 14:25:57.484334 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.484317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 14:25:57.493624 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.493602 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:25:57.509094 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.509068 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789"] Jul 06 14:25:57.511600 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:57.511577 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fc8be2_0285_4c47_9049_f06174392068.slice/crio-f0a13e70d2e921887afe5fc49e03b6742dbee296f7132c088f9938b7ff0cdab3 WatchSource:0}: Error finding container f0a13e70d2e921887afe5fc49e03b6742dbee296f7132c088f9938b7ff0cdab3: Status 404 returned error can't find the container with id f0a13e70d2e921887afe5fc49e03b6742dbee296f7132c088f9938b7ff0cdab3 Jul 06 14:25:57.538967 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.538937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.538994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85w8r\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.539638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.539566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.540287 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.540219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.640387 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640387 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640387 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85w8r\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640931 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:25:57.640651 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle podName:aa30dcbe-7924-492b-8989-7181d2773cf0 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:58.140625032 +0000 UTC m=+76.283113662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0") : configmap references non-existent config key: ca-bundle.crt Jul 06 14:25:57.640931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.640931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.641372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.640942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.641372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.641256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.641372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.641351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.643624 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.643597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.643855 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.643811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.643986 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.643964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.644281 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.644257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.644353 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.644312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.644394 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.644377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.644913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.644886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.644991 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.644956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.645573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.645557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.649938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.649920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85w8r\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:57.675607 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.675579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.774373 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.774337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:57.904248 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.904161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" event={"ID":"13fc8be2-0285-4c47-9049-f06174392068","Type":"ContainerStarted","Data":"f0a13e70d2e921887afe5fc49e03b6742dbee296f7132c088f9938b7ff0cdab3"} Jul 06 14:25:57.905301 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:57.905280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8jp5" event={"ID":"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b","Type":"ContainerStarted","Data":"dc5bff25cfbb38ed14ae81a7786b25489226bb5ae98ccabfdf590b270933d08c"} Jul 06 14:25:58.044036 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.043975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:58.046911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.046884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5777ff9-44b0-4ff4-b79c-0ec496e461dc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frmpz\" (UID: \"e5777ff9-44b0-4ff4-b79c-0ec496e461dc\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:58.144887 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.144845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:58.145831 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.145809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:58.215079 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.214815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" Jul 06 14:25:58.390884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.390847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:25:58.391142 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.391115 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz"] Jul 06 14:25:58.509524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.509439 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-778fd4886c-95dhm"] Jul 06 14:25:58.513211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.513182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.516516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.515960 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 14:25:58.516516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.516113 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 14:25:58.516516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.516324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 14:25:58.516516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.516383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 14:25:58.516841 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.516595 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 14:25:58.516906 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.516871 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tg6x2\"" Jul 06 14:25:58.517119 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.517099 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-23ufqjt2kqb05\"" Jul 06 14:25:58.534787 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.530534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-778fd4886c-95dhm"] Jul 06 14:25:58.550241 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67092fb2-0192-4a68-a3c8-50b11f9f5027-metrics-client-ca\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqdm4\" (UniqueName: \"kubernetes.io/projected/67092fb2-0192-4a68-a3c8-50b11f9f5027-kube-api-access-gqdm4\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-grpc-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.550614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.550603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.597496 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:58.597460 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5777ff9_44b0_4ff4_b79c_0ec496e461dc.slice/crio-f35b7f2a5992371c515538ebfa7f56b7cbcf0c11a3136d7bc39448dcdc4117ff WatchSource:0}: Error finding container f35b7f2a5992371c515538ebfa7f56b7cbcf0c11a3136d7bc39448dcdc4117ff: Status 404 returned error can't find the container with id f35b7f2a5992371c515538ebfa7f56b7cbcf0c11a3136d7bc39448dcdc4117ff Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67092fb2-0192-4a68-a3c8-50b11f9f5027-metrics-client-ca\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqdm4\" (UniqueName: \"kubernetes.io/projected/67092fb2-0192-4a68-a3c8-50b11f9f5027-kube-api-access-gqdm4\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-grpc-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.653020 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.652668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67092fb2-0192-4a68-a3c8-50b11f9f5027-metrics-client-ca\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.655666 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.655637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.655852 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.655826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.657858 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.657813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.658375 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.658334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.658801 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.658493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-grpc-tls\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.659040 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.658988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67092fb2-0192-4a68-a3c8-50b11f9f5027-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.674080 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.674025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqdm4\" (UniqueName: \"kubernetes.io/projected/67092fb2-0192-4a68-a3c8-50b11f9f5027-kube-api-access-gqdm4\") pod \"thanos-querier-778fd4886c-95dhm\" (UID: \"67092fb2-0192-4a68-a3c8-50b11f9f5027\") " pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.780008 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.779627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:25:58.837148 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.837118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:25:58.911882 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.911379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8jp5" event={"ID":"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b","Type":"ContainerStarted","Data":"440d8b67d5b8b018bbfed389eb246728fccc65e15ed3606edae3495d484ac540"} Jul 06 14:25:58.913152 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.913123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" event={"ID":"e5777ff9-44b0-4ff4-b79c-0ec496e461dc","Type":"ContainerStarted","Data":"6f4a23c47a955fbe4a104651a39ae63143240b957982d70dc732ecccdceb868e"} Jul 06 14:25:58.913259 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:58.913180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" event={"ID":"e5777ff9-44b0-4ff4-b79c-0ec496e461dc","Type":"ContainerStarted","Data":"f35b7f2a5992371c515538ebfa7f56b7cbcf0c11a3136d7bc39448dcdc4117ff"} Jul 06 14:25:59.111128 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:59.111094 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa30dcbe_7924_492b_8989_7181d2773cf0.slice/crio-ca7877e6a4416932e5d6541c84e14bb737306dd4ae840200c6c80cea9ba8d83e WatchSource:0}: Error finding container ca7877e6a4416932e5d6541c84e14bb737306dd4ae840200c6c80cea9ba8d83e: Status 404 returned error can't find the container with id ca7877e6a4416932e5d6541c84e14bb737306dd4ae840200c6c80cea9ba8d83e Jul 06 14:25:59.281966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.281881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-778fd4886c-95dhm"] Jul 06 14:25:59.285609 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:25:59.285566 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67092fb2_0192_4a68_a3c8_50b11f9f5027.slice/crio-3559cfd5a2fffa05754fa851259bf8fead18403e90455c718990f6b3e81b71dd WatchSource:0}: Error finding container 3559cfd5a2fffa05754fa851259bf8fead18403e90455c718990f6b3e81b71dd: Status 404 returned error can't find the container with id 3559cfd5a2fffa05754fa851259bf8fead18403e90455c718990f6b3e81b71dd Jul 06 14:25:59.422624 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.422592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:59.500699 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.500657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:59.605863 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.605827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:59.707033 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.707006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:59.781652 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.781599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:25:59.920277 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.920239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" event={"ID":"13fc8be2-0285-4c47-9049-f06174392068","Type":"ContainerStarted","Data":"b46df415b78d1be27de8a65dc810a2e6ac474fbd5be43c02aeca3383e22fc49b"} Jul 06 14:25:59.920460 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.920312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" event={"ID":"13fc8be2-0285-4c47-9049-f06174392068","Type":"ContainerStarted","Data":"3c5a9598c1ccc548fc052ef53a1f3cbc181b9a4512b934418b1cbe78cbdc673f"} Jul 06 14:25:59.920460 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.920336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" event={"ID":"13fc8be2-0285-4c47-9049-f06174392068","Type":"ContainerStarted","Data":"952017dce2b4e5a5a87760d1ffbd14716360b058d41f7ca2252922445fba89bc"} Jul 06 14:25:59.922100 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.922070 2578 generic.go:356] "Generic (PLEG): container finished" podID="8daa4865-ff66-4ae5-b07c-15eeaa46ef5b" containerID="440d8b67d5b8b018bbfed389eb246728fccc65e15ed3606edae3495d484ac540" exitCode=0 Jul 06 14:25:59.922226 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.922137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8jp5" event={"ID":"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b","Type":"ContainerDied","Data":"440d8b67d5b8b018bbfed389eb246728fccc65e15ed3606edae3495d484ac540"} Jul 06 14:25:59.924262 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.924237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" event={"ID":"e5777ff9-44b0-4ff4-b79c-0ec496e461dc","Type":"ContainerStarted","Data":"f76d164e0e129eac4aab8efcc61d0c1ee6ad51027adfb42448633e852c7c500b"} Jul 06 14:25:59.925761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.925739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"3559cfd5a2fffa05754fa851259bf8fead18403e90455c718990f6b3e81b71dd"} Jul 06 14:25:59.927591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.927572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"ca7877e6a4416932e5d6541c84e14bb737306dd4ae840200c6c80cea9ba8d83e"} Jul 06 14:25:59.946871 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:25:59.946824 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-vt789" podStartSLOduration=2.320197111 podStartE2EDuration="3.946802784s" totalImagesPullingTime="1.626605673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:59.944674234 +0000 UTC m=+78.087162872" watchObservedRunningTime="2026-07-06 14:25:59.946802784 +0000 UTC m=+78.089291414" Jul 06 14:26:00.008196 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.008138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:00.726343 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.725564 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86988bd656-q9xmc"] Jul 06 14:26:00.733213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.733180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.736218 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.736190 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c7ml9\"" Jul 06 14:26:00.739783 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.739741 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 14:26:00.740400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.739932 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 14:26:00.740400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.739873 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 14:26:00.740400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.739918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 14:26:00.740400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.740264 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4a90djvg3tjap\"" Jul 06 14:26:00.741758 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.741707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86988bd656-q9xmc"] Jul 06 14:26:00.773118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-tls\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-client-certs\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94a22d49-b674-4df1-88cb-1a6e979ee7bc-audit-log\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9c4\" (UniqueName: \"kubernetes.io/projected/94a22d49-b674-4df1-88cb-1a6e979ee7bc-kube-api-access-7f9c4\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-metrics-server-audit-profiles\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.773485 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.773298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-client-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-metrics-server-audit-profiles\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-client-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-tls\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-client-certs\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.874636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94a22d49-b674-4df1-88cb-1a6e979ee7bc-audit-log\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.875041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.874672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9c4\" (UniqueName: \"kubernetes.io/projected/94a22d49-b674-4df1-88cb-1a6e979ee7bc-kube-api-access-7f9c4\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.875347 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.875317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-metrics-server-audit-profiles\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.875969 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.875867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a22d49-b674-4df1-88cb-1a6e979ee7bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.875969 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.875928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94a22d49-b674-4df1-88cb-1a6e979ee7bc-audit-log\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.877613 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.877590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-client-ca-bundle\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.879726 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.879700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-tls\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.879866 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.879838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94a22d49-b674-4df1-88cb-1a6e979ee7bc-secret-metrics-server-client-certs\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.886880 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.886273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9c4\" (UniqueName: \"kubernetes.io/projected/94a22d49-b674-4df1-88cb-1a6e979ee7bc-kube-api-access-7f9c4\") pod \"metrics-server-86988bd656-q9xmc\" (UID: \"94a22d49-b674-4df1-88cb-1a6e979ee7bc\") " pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:00.933985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.933956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:00.934156 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.934123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8jp5" event={"ID":"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b","Type":"ContainerStarted","Data":"b7210e34ad9656a3cc1a7d4e014751273064dbb2ea8671c0aab1bc76a2c2686e"} Jul 06 14:26:00.934209 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.934177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8jp5" event={"ID":"8daa4865-ff66-4ae5-b07c-15eeaa46ef5b","Type":"ContainerStarted","Data":"9dd9b2628f4f6fb16120b6c347cea931b6a51df620c60d5d8081a87af748abb7"} Jul 06 14:26:00.954520 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:00.954472 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v8jp5" podStartSLOduration=3.5845729 podStartE2EDuration="4.954460391s" totalImagesPullingTime="1.288511946s" totalInitContainerRuntime="81.375545ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:00.953737038 +0000 UTC m=+79.096225696" watchObservedRunningTime="2026-07-06 14:26:00.954460391 +0000 UTC m=+79.096949003" Jul 06 14:26:01.034546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.034469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.049836 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.049542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:01.158298 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.157907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.171977 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.170514 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp"] Jul 06 14:26:01.173859 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.173116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.176595 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.176526 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 14:26:01.176865 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.176849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ksxpf\"" Jul 06 14:26:01.183396 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.183334 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp"] Jul 06 14:26:01.225959 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.225928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86988bd656-q9xmc"] Jul 06 14:26:01.228321 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.228281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.279670 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.279637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmqjq\" (UniqueName: \"kubernetes.io/projected/1da72a84-41c2-49fe-b81c-e2c34d090f89-kube-api-access-tmqjq\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.279901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.279750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1da72a84-41c2-49fe-b81c-e2c34d090f89-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.317686 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.317654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.380540 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.380501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1da72a84-41c2-49fe-b81c-e2c34d090f89-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.380711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.380563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmqjq\" (UniqueName: \"kubernetes.io/projected/1da72a84-41c2-49fe-b81c-e2c34d090f89-kube-api-access-tmqjq\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.383651 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.383597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1da72a84-41c2-49fe-b81c-e2c34d090f89-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.391675 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.391647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmqjq\" (UniqueName: \"kubernetes.io/projected/1da72a84-41c2-49fe-b81c-e2c34d090f89-kube-api-access-tmqjq\") pod \"monitoring-plugin-d5dcff7cf-mpmhp\" (UID: \"1da72a84-41c2-49fe-b81c-e2c34d090f89\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.428513 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.428399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.490927 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.490891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:01.529594 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.529522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:01.620337 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.620297 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7799f686d8-tpcnl"] Jul 06 14:26:01.623256 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.623230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l94pp\"" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626028 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626147 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 14:26:01.626459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.626296 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 14:26:01.632370 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.632349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 14:26:01.637710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.637687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7799f686d8-tpcnl"] Jul 06 14:26:01.682654 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-federate-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682654 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc52g\" (UniqueName: \"kubernetes.io/projected/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-kube-api-access-wc52g\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-serving-certs-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.682898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-metrics-client-ca\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.683102 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.682944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.783981 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.783938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.783990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-federate-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc52g\" (UniqueName: \"kubernetes.io/projected/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-kube-api-access-wc52g\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-serving-certs-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-metrics-client-ca\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.784955 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.784874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-metrics-client-ca\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.785546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.785502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.785823 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.785709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-serving-certs-ca-bundle\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.787200 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.787157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-telemeter-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.787200 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.787179 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-federate-client-tls\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.787367 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.787343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.788021 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.787999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.795593 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.795555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc52g\" (UniqueName: \"kubernetes.io/projected/86ec2be2-d83a-4a20-9e7d-ce6fad636b8a-kube-api-access-wc52g\") pod \"telemeter-client-7799f686d8-tpcnl\" (UID: \"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a\") " pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.852399 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:26:01.852368 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a22d49_b674_4df1_88cb_1a6e979ee7bc.slice/crio-7b8639cc23a86264380308aa302c4935954e32dca3d9b9a9036fe6f1f6faa6e7 WatchSource:0}: Error finding container 7b8639cc23a86264380308aa302c4935954e32dca3d9b9a9036fe6f1f6faa6e7: Status 404 returned error can't find the container with id 7b8639cc23a86264380308aa302c4935954e32dca3d9b9a9036fe6f1f6faa6e7 Jul 06 14:26:01.936427 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.936359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" Jul 06 14:26:01.941552 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.941201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" event={"ID":"94a22d49-b674-4df1-88cb-1a6e979ee7bc","Type":"ContainerStarted","Data":"7b8639cc23a86264380308aa302c4935954e32dca3d9b9a9036fe6f1f6faa6e7"} Jul 06 14:26:01.943951 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.943906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" event={"ID":"e5777ff9-44b0-4ff4-b79c-0ec496e461dc","Type":"ContainerStarted","Data":"4bc160f69d59d1c24ececb1a77ca2e61d7aac08a160415b8390074c27771a110"} Jul 06 14:26:01.947171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.945882 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f" exitCode=0 Jul 06 14:26:01.947171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.947103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f"} Jul 06 14:26:01.968806 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:01.968083 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frmpz" podStartSLOduration=4.502664943 podStartE2EDuration="5.968063026s" totalImagesPullingTime="1.465398083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:01.967946671 +0000 UTC m=+80.110435305" watchObservedRunningTime="2026-07-06 14:26:01.968063026 +0000 UTC m=+80.110551661" Jul 06 14:26:02.001605 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.001579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp"] Jul 06 14:26:02.008081 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:26:02.008052 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da72a84_41c2_49fe_b81c_e2c34d090f89.slice/crio-f525b740c132b98d3b0f30cdbf98c3d338b80b9f0db1561068b13f60eb254042 WatchSource:0}: Error finding container f525b740c132b98d3b0f30cdbf98c3d338b80b9f0db1561068b13f60eb254042: Status 404 returned error can't find the container with id f525b740c132b98d3b0f30cdbf98c3d338b80b9f0db1561068b13f60eb254042 Jul 06 14:26:02.120069 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.120042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7799f686d8-tpcnl"] Jul 06 14:26:02.133455 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:26:02.133427 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ec2be2_d83a_4a20_9e7d_ce6fad636b8a.slice/crio-4734d38cf8398a0fb3adc328c8263d3d59b17ef12efbd6395a985a42b099f67a WatchSource:0}: Error finding container 4734d38cf8398a0fb3adc328c8263d3d59b17ef12efbd6395a985a42b099f67a: Status 404 returned error can't find the container with id 4734d38cf8398a0fb3adc328c8263d3d59b17ef12efbd6395a985a42b099f67a Jul 06 14:26:02.771928 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.771456 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:26:02.775298 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.775239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:02.777849 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.776904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.781978 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.782181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.782351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.782528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c92nn\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.782714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.783145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 14:26:02.784918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.783331 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 14:26:02.788306 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788514 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788744 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-12nl05nohkad2\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.788974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.789158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 14:26:02.793814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.789458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 14:26:02.811662 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.807195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:26:02.820695 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.820670 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 14:26:02.895481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.895446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.898985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.898998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5s5c\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.899497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.899459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:02.926537 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.926480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:02.957287 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.957178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" event={"ID":"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a","Type":"ContainerStarted","Data":"4734d38cf8398a0fb3adc328c8263d3d59b17ef12efbd6395a985a42b099f67a"} Jul 06 14:26:02.961347 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.961079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" event={"ID":"1da72a84-41c2-49fe-b81c-e2c34d090f89","Type":"ContainerStarted","Data":"f525b740c132b98d3b0f30cdbf98c3d338b80b9f0db1561068b13f60eb254042"} Jul 06 14:26:02.967581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.966336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"76e8237aad6176e81b4310d63a1af77e7c55e5d901f07c03e17706416f695ec0"} Jul 06 14:26:02.967581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.966407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"0acb37059fb340788e64b2c9603485822f3b4f815ba6600bc610ee07e00927a7"} Jul 06 14:26:02.967581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:02.966449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"2530d8879a4383d36a9e379b7ab121b537372ab10d6a02edc58057e05ed2d724"} Jul 06 14:26:03.000073 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5s5c\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000381 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000381 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000381 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.000622 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.000594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001625 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001735 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001735 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001735 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.001970 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.002421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.001972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.002617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.002596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.006300 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.004080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.006300 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.004655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.006300 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.005280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.006300 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.006030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.010867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.007390 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.010867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.007878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.010867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.010809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.011117 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.011092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5s5c\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.014630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.011859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.014630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.013120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.014630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.013513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.014630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.013537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.014630 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.014581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.015404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.015310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.016105 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.016063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.017516 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.017475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.018313 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.018273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.021177 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.021128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out\") pod \"prometheus-k8s-0\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.032553 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.032485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:03.120279 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.120219 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:03.335941 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.335831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:26:03.339071 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:26:03.339016 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb356579_2b48_4ae4_81e0_9dfb49c6c462.slice/crio-01ad98b7b2f5b2a6ccbd9da02b0e9108cd0e59bb7819bdc1d9816fdfe5ed2bae WatchSource:0}: Error finding container 01ad98b7b2f5b2a6ccbd9da02b0e9108cd0e59bb7819bdc1d9816fdfe5ed2bae: Status 404 returned error can't find the container with id 01ad98b7b2f5b2a6ccbd9da02b0e9108cd0e59bb7819bdc1d9816fdfe5ed2bae Jul 06 14:26:03.972914 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.972370 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="83363735f51435cf851084e1a4c6e8ec4b1f87f7d8f900ddd6422a682c075f4d" exitCode=0 Jul 06 14:26:03.972914 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.972434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"83363735f51435cf851084e1a4c6e8ec4b1f87f7d8f900ddd6422a682c075f4d"} Jul 06 14:26:03.972914 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:03.972505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"01ad98b7b2f5b2a6ccbd9da02b0e9108cd0e59bb7819bdc1d9816fdfe5ed2bae"} Jul 06 14:26:05.993682 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:05.993640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" event={"ID":"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a","Type":"ContainerStarted","Data":"d401a38ae522933602c853d430d3fbd71ab7a0cfb0293c33e6ac61ba6a45207e"} Jul 06 14:26:05.994068 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:05.993753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" event={"ID":"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a","Type":"ContainerStarted","Data":"fb04a490ea7ffec84bae659a987288fbd37b360358ef8d35d957260fbba2e30e"} Jul 06 14:26:05.999713 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:05.997395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af"} Jul 06 14:26:05.999713 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:05.997472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e"} Jul 06 14:26:06.000231 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.000160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" event={"ID":"94a22d49-b674-4df1-88cb-1a6e979ee7bc","Type":"ContainerStarted","Data":"c4833d0d31142aeea00860868a9dde604be1623d2182e3378219a1953e0902bb"} Jul 06 14:26:06.003587 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.003561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" event={"ID":"1da72a84-41c2-49fe-b81c-e2c34d090f89","Type":"ContainerStarted","Data":"943e97322ed0a0e696902a9ebb3396e3437aeb93438b8d6dae92e941e2295047"} Jul 06 14:26:06.004339 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.004320 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:06.012668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.010475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"2f470a38bd9673a6f6a55e4562697d0a8d742f11c069b174d9b8d828d861e6de"} Jul 06 14:26:06.012668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.010544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"3ff87c36f6bd54d8b7bb61dca2069fe38123826ba7439f83a36791135b4a8e95"} Jul 06 14:26:06.014719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.013967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" Jul 06 14:26:06.025797 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.025470 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" podStartSLOduration=2.174645247 podStartE2EDuration="6.025448835s" totalImagesPullingTime="3.850803588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:06.024073611 +0000 UTC m=+84.166562261" watchObservedRunningTime="2026-07-06 14:26:06.025448835 +0000 UTC m=+84.167937471" Jul 06 14:26:06.044931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:06.044697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpmhp" podStartSLOduration=1.348716404 podStartE2EDuration="5.044674236s" totalImagesPullingTime="3.695957832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:06.044071926 +0000 UTC m=+84.186560561" watchObservedRunningTime="2026-07-06 14:26:06.044674236 +0000 UTC m=+84.187162871" Jul 06 14:26:07.018730 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.018692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" event={"ID":"67092fb2-0192-4a68-a3c8-50b11f9f5027","Type":"ContainerStarted","Data":"1209d941f65fc8d49e33d0f6953cf32d8a694d334b7f1ca54ad77171912817de"} Jul 06 14:26:07.019239 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.018864 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:26:07.022166 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.022138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" event={"ID":"86ec2be2-d83a-4a20-9e7d-ce6fad636b8a","Type":"ContainerStarted","Data":"accae95b782aef512ab4a89624b0fd566dff5d2591f138270990997058d53177"} Jul 06 14:26:07.026326 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.026293 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" Jul 06 14:26:07.026459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.026436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0"} Jul 06 14:26:07.026536 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.026513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c"} Jul 06 14:26:07.026590 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.026544 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c"} Jul 06 14:26:07.026590 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.026580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerStarted","Data":"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946"} Jul 06 14:26:07.057734 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.053845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-778fd4886c-95dhm" podStartSLOduration=2.8999974269999997 podStartE2EDuration="9.05382478s" totalImagesPullingTime="6.153827353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:07.050450356 +0000 UTC m=+85.192938987" watchObservedRunningTime="2026-07-06 14:26:07.05382478 +0000 UTC m=+85.196313414" Jul 06 14:26:07.083290 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:07.083226 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.407624018 podStartE2EDuration="10.083208046s" totalImagesPullingTime="5.652568085s" totalInitContainerRuntime="23.015943ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:07.082290596 +0000 UTC m=+85.224779234" watchObservedRunningTime="2026-07-06 14:26:07.083208046 +0000 UTC m=+85.225696684" Jul 06 14:26:09.895853 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:09.895810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:09.956663 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:09.956620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:13.417105 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:13.417068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:13.516567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:13.516532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:14.443285 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:14.443247 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:14.540591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:14.540564 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.703114 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:16.703084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:16.803295 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:16.803254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:17.280725 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:17.280704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:17.382755 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:17.382711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:18.087313 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.087270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-mtn2l" event={"ID":"d2ecd67a-0d65-4ebd-ba68-836b66c4011d","Type":"ContainerStarted","Data":"32fa5b1ea741292120233bf3ef19081e6c3da7489820126b12b9431795586a69"} Jul 06 14:26:18.087798 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.087695 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:26:18.091693 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"d3f17ef775d0fcf353019cf0c68b0b89c6b4ce0296edf23c62fa0c5bf059d771"} Jul 06 14:26:18.091831 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"ae2057b4b45589354374422c7fc423fae74cb730ba9453db6535700c9644285b"} Jul 06 14:26:18.091831 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"49e88c6f9cff351073852a7846a424f7cb453821489e36dc9ac5c911d16b163a"} Jul 06 14:26:18.091831 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091813 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"76e86b5a70c46ff7fa50a4ac0b26015e405a2a95fed45368fb43419f9736f630"} Jul 06 14:26:18.091973 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"42f2767952f62d2b48cdb12da3bec76b680e600b7d2eabe2c882cee8f28b46de"} Jul 06 14:26:18.091973 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.091858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerStarted","Data":"d60faf18965007b00e9f7f658ff4d46798b24fb50ce1bc153639f0a73bcbee6b"} Jul 06 14:26:18.108938 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.108856 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7799f686d8-tpcnl" podStartSLOduration=13.532338972 podStartE2EDuration="17.108840379s" totalImagesPullingTime="3.576501407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:07.146159057 +0000 UTC m=+85.288647688" watchObservedRunningTime="2026-07-06 14:26:18.108840379 +0000 UTC m=+96.251329015" Jul 06 14:26:18.109502 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.109471 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-mtn2l" podStartSLOduration=2.250647003 podStartE2EDuration="24.109462528s" totalImagesPullingTime="21.858815525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:18.107179501 +0000 UTC m=+96.249668155" watchObservedRunningTime="2026-07-06 14:26:18.109462528 +0000 UTC m=+96.251951160" Jul 06 14:26:18.110956 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.110931 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-mtn2l" Jul 06 14:26:18.121355 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.121331 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:26:18.142089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:18.142032 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9353629679999997 podStartE2EDuration="16.142011868s" totalImagesPullingTime="13.182778006s" totalInitContainerRuntime="23.870894ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:18.141594956 +0000 UTC m=+96.284083612" watchObservedRunningTime="2026-07-06 14:26:18.142011868 +0000 UTC m=+96.284500502" Jul 06 14:26:19.124196 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:19.124159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:19.222149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:19.222111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:20.299878 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:20.299837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:21.050317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:21.050263 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:21.050500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:21.050351 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:22.043675 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:22.043632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:22.113912 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:22.113877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:23.228394 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:23.228353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:23.315460 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:23.315417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:23.715417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:23.715375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:23.780146 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:23.780117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:24.727508 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:24.727472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:24.808656 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:24.808625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:25.733011 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:25.732971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:25.814514 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:25.814472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:25.898538 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:25.898509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f9kmf" Jul 06 14:26:38.232237 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:38.232204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:38.329372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:38.329313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:26:41.055946 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:41.055912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:26:41.061276 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:26:41.061241 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86988bd656-q9xmc" Jul 06 14:27:03.121119 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:03.121082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:03.185847 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:03.185821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:03.320525 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:03.320492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:10.995013 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:10.994958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:12.640259 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:12.640217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:12.779828 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:12.779788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:13.279973 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:13.279910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:16.930209 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930171 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:16.930678 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930589 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="alertmanager" containerID="cri-o://1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e" gracePeriod=120 Jul 06 14:27:16.930678 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930635 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-metric" containerID="cri-o://92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c" gracePeriod=120 Jul 06 14:27:16.930835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930666 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-web" containerID="cri-o://16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946" gracePeriod=120 Jul 06 14:27:16.930835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930693 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy" containerID="cri-o://48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c" gracePeriod=120 Jul 06 14:27:16.930835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930718 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="config-reloader" containerID="cri-o://a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af" gracePeriod=120 Jul 06 14:27:16.930953 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:16.930893 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="prom-label-proxy" containerID="cri-o://bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0" gracePeriod=120 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364394 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0" exitCode=0 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364423 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c" exitCode=0 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364432 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c" exitCode=0 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364440 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af" exitCode=0 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364449 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e" exitCode=0 Jul 06 14:27:17.364473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0"} Jul 06 14:27:17.364754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c"} Jul 06 14:27:17.364754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c"} Jul 06 14:27:17.364754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af"} Jul 06 14:27:17.364754 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:17.364604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e"} Jul 06 14:27:18.175187 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.175164 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.211139 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211111 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211148 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211176 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211316 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211369 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211404 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211479 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211509 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85w8r\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211554 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211553 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:18.211744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211580 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.211744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211625 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls\") pod \"aa30dcbe-7924-492b-8989-7181d2773cf0\" (UID: \"aa30dcbe-7924-492b-8989-7181d2773cf0\") " Jul 06 14:27:18.212017 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.211968 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.213080 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.212244 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:18.213080 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.212583 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:27:18.216120 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.216080 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.216523 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.216325 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out" (OuterVolumeSpecName: "config-out") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:27:18.216523 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.216411 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.216523 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.216461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.216728 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.216581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.218081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.218052 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume" (OuterVolumeSpecName: "config-volume") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.218789 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.218721 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:18.218886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.218813 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r" (OuterVolumeSpecName: "kube-api-access-85w8r") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "kube-api-access-85w8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:18.221965 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.221760 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.232704 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.232681 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config" (OuterVolumeSpecName: "web-config") pod "aa30dcbe-7924-492b-8989-7181d2773cf0" (UID: "aa30dcbe-7924-492b-8989-7181d2773cf0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:18.312787 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312743 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312787 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312789 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-cluster-tls-config\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312800 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa30dcbe-7924-492b-8989-7181d2773cf0-metrics-client-ca\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312809 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-config-out\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312818 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-web-config\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312825 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-config-volume\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312833 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85w8r\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-kube-api-access-85w8r\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312842 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa30dcbe-7924-492b-8989-7181d2773cf0-alertmanager-main-db\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312850 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa30dcbe-7924-492b-8989-7181d2773cf0-tls-assets\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312868 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-main-tls\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312877 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.312966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.312886 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa30dcbe-7924-492b-8989-7181d2773cf0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:18.376088 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.376051 2578 generic.go:356] "Generic (PLEG): container finished" podID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerID="16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946" exitCode=0 Jul 06 14:27:18.376246 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.376110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946"} Jul 06 14:27:18.376246 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.376127 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.376246 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.376207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa30dcbe-7924-492b-8989-7181d2773cf0","Type":"ContainerDied","Data":"ca7877e6a4416932e5d6541c84e14bb737306dd4ae840200c6c80cea9ba8d83e"} Jul 06 14:27:18.376420 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.376254 2578 scope.go:117] "RemoveContainer" containerID="bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0" Jul 06 14:27:18.384453 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.384432 2578 scope.go:117] "RemoveContainer" containerID="92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c" Jul 06 14:27:18.391506 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.391490 2578 scope.go:117] "RemoveContainer" containerID="48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c" Jul 06 14:27:18.398327 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.398308 2578 scope.go:117] "RemoveContainer" containerID="16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946" Jul 06 14:27:18.405150 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.405127 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:18.405572 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.405555 2578 scope.go:117] "RemoveContainer" containerID="a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af" Jul 06 14:27:18.409715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.409693 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:18.413149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.413131 2578 scope.go:117] "RemoveContainer" containerID="1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e" Jul 06 14:27:18.420189 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.420174 2578 scope.go:117] "RemoveContainer" containerID="c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f" Jul 06 14:27:18.427280 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.427224 2578 scope.go:117] "RemoveContainer" containerID="bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0" Jul 06 14:27:18.427573 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.427537 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0\": container with ID starting with bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0 not found: ID does not exist" containerID="bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0" Jul 06 14:27:18.427671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.427585 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0"} err="failed to get container status \"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0\": rpc error: code = NotFound desc = could not find container \"bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0\": container with ID starting with bbdece2c7745ab1df60682c1af1d38cc2ebbb8df4a2313530a5a6d35a20f06a0 not found: ID does not exist" Jul 06 14:27:18.427671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.427626 2578 scope.go:117] "RemoveContainer" containerID="92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c" Jul 06 14:27:18.427918 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.427903 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c\": container with ID starting with 92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c not found: ID does not exist" containerID="92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c" Jul 06 14:27:18.427978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.427923 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c"} err="failed to get container status \"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c\": rpc error: code = NotFound desc = could not find container \"92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c\": container with ID starting with 92f976c83bbfa0b4d101edcc366f348fe46ca688413d10a8fc0a7127b83c119c not found: ID does not exist" Jul 06 14:27:18.427978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.427940 2578 scope.go:117] "RemoveContainer" containerID="48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c" Jul 06 14:27:18.428212 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.428188 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c\": container with ID starting with 48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c not found: ID does not exist" containerID="48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c" Jul 06 14:27:18.428253 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428219 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c"} err="failed to get container status \"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c\": rpc error: code = NotFound desc = could not find container \"48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c\": container with ID starting with 48089a7b36b6139749d545ccf2e5f0c1d3409a6aabf9fdd4e9e6b8a38af4fe5c not found: ID does not exist" Jul 06 14:27:18.428253 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428237 2578 scope.go:117] "RemoveContainer" containerID="16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946" Jul 06 14:27:18.428433 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.428418 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946\": container with ID starting with 16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946 not found: ID does not exist" containerID="16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946" Jul 06 14:27:18.428474 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428437 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946"} err="failed to get container status \"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946\": rpc error: code = NotFound desc = could not find container \"16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946\": container with ID starting with 16345d83de12e13472754af4ea942de254161823864002f1a005ec6f02147946 not found: ID does not exist" Jul 06 14:27:18.428474 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428452 2578 scope.go:117] "RemoveContainer" containerID="a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af" Jul 06 14:27:18.428681 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.428667 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af\": container with ID starting with a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af not found: ID does not exist" containerID="a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af" Jul 06 14:27:18.428741 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428684 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af"} err="failed to get container status \"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af\": rpc error: code = NotFound desc = could not find container \"a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af\": container with ID starting with a02717a9f6bf1485ffa970857f1ac3b05ef09f9196f4a48e96279062505cf0af not found: ID does not exist" Jul 06 14:27:18.428741 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428695 2578 scope.go:117] "RemoveContainer" containerID="1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e" Jul 06 14:27:18.428934 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.428919 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e\": container with ID starting with 1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e not found: ID does not exist" containerID="1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e" Jul 06 14:27:18.428988 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428937 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e"} err="failed to get container status \"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e\": rpc error: code = NotFound desc = could not find container \"1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e\": container with ID starting with 1b2172be2bb2f54c189d115649b87cd7a72ea3d1d6fbca0f5144ae539b55e51e not found: ID does not exist" Jul 06 14:27:18.428988 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.428949 2578 scope.go:117] "RemoveContainer" containerID="c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f" Jul 06 14:27:18.429163 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:27:18.429148 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f\": container with ID starting with c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f not found: ID does not exist" containerID="c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f" Jul 06 14:27:18.429202 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.429164 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f"} err="failed to get container status \"c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f\": rpc error: code = NotFound desc = could not find container \"c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f\": container with ID starting with c4492db8ac4f51c7a6b33e86d76e8f651cb1f2e878b655998b40700939327a0f not found: ID does not exist" Jul 06 14:27:18.438519 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438498 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:18.438863 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438849 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="alertmanager" Jul 06 14:27:18.438901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438865 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="alertmanager" Jul 06 14:27:18.438901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438879 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="config-reloader" Jul 06 14:27:18.438901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438885 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="config-reloader" Jul 06 14:27:18.438901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438896 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-web" Jul 06 14:27:18.438901 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438901 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-web" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438907 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="prom-label-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438912 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="prom-label-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438922 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="init-config-reloader" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438927 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="init-config-reloader" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438934 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438939 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438944 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-metric" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.438949 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-metric" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439000 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439005 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="prom-label-proxy" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439013 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="config-reloader" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439018 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-web" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439022 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="kube-rbac-proxy-metric" Jul 06 14:27:18.439041 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.439027 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" containerName="alertmanager" Jul 06 14:27:18.442529 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.442506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.445203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 14:27:18.445335 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445322 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 14:27:18.445417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-klpmj\"" Jul 06 14:27:18.445417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 14:27:18.445417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445326 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 14:27:18.445417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 14:27:18.445603 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 14:27:18.445675 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 14:27:18.445723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.445669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 14:27:18.450759 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.450741 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 14:27:18.454607 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.454586 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa30dcbe-7924-492b-8989-7181d2773cf0" path="/var/lib/kubelet/pods/aa30dcbe-7924-492b-8989-7181d2773cf0/volumes" Jul 06 14:27:18.462940 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.462905 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:18.514732 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514732 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-out\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd568\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-kube-api-access-vd568\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.514984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.514964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.515217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.515010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-web-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.515217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.515036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.515217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.515064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.515217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.515135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.515217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.515160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616195 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616195 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-out\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd568\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-kube-api-access-vd568\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-web-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.616913 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.616591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.617443 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.617419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.617693 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.617666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619539 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619512 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-out\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619539 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619697 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619697 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619830 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619756 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7428f73c-fe54-45c2-b856-8b0aaa276ea2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.619884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.619837 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.620183 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.620161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-config-volume\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.620415 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.620398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.620558 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.620542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-web-config\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.621487 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.621470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7428f73c-fe54-45c2-b856-8b0aaa276ea2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.625688 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.625662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd568\" (UniqueName: \"kubernetes.io/projected/7428f73c-fe54-45c2-b856-8b0aaa276ea2-kube-api-access-vd568\") pod \"alertmanager-main-0\" (UID: \"7428f73c-fe54-45c2-b856-8b0aaa276ea2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.752201 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.752169 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 14:27:18.892238 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:18.892213 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 14:27:18.894249 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:27:18.894217 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7428f73c_fe54_45c2_b856_8b0aaa276ea2.slice/crio-73098ae00b51b19399152971406dff96f1064fc52cb36a441ba33173f0ec16eb WatchSource:0}: Error finding container 73098ae00b51b19399152971406dff96f1064fc52cb36a441ba33173f0ec16eb: Status 404 returned error can't find the container with id 73098ae00b51b19399152971406dff96f1064fc52cb36a441ba33173f0ec16eb Jul 06 14:27:19.383094 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.383062 2578 generic.go:356] "Generic (PLEG): container finished" podID="7428f73c-fe54-45c2-b856-8b0aaa276ea2" containerID="b1d71119575d438089bcea7c7229c509fc5fc484f03355058974f3a23cb8618c" exitCode=0 Jul 06 14:27:19.383439 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.383113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerDied","Data":"b1d71119575d438089bcea7c7229c509fc5fc484f03355058974f3a23cb8618c"} Jul 06 14:27:19.383439 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.383162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"73098ae00b51b19399152971406dff96f1064fc52cb36a441ba33173f0ec16eb"} Jul 06 14:27:19.684217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.684187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:19.792194 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.792159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:19.889555 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:19.889474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:20.320456 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.320418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:20.382598 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.382560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:20.395504 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"f90a167a8cc5e64e2f84b2da1f1862dfe81481b8a64195d86b7b6020f35efd53"} Jul 06 14:27:20.396004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"f8429754a8a0f3b2d000af987472c21624072d144a6c7e3715b324ba88c93b86"} Jul 06 14:27:20.396004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"5673c1cc6fce6e4aa7e971637ab02461d7bdfdc2893bb0c49f30d94c425d0cf4"} Jul 06 14:27:20.396004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"b5a2d90a426d0c016100efde9435f1ddd5f25f766f1725e0bf16a54a687ede31"} Jul 06 14:27:20.396004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"638abbf1bcd82761a7c29d3a9b8f4f43bb3c0e668c25c09d05d0b357621d1e6b"} Jul 06 14:27:20.396004 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.395752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7428f73c-fe54-45c2-b856-8b0aaa276ea2","Type":"ContainerStarted","Data":"d5c3efd57b12cf137507c6b7d0162af1bf34f1386aeec7081c4e6b04fb61af51"} Jul 06 14:27:20.422593 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:20.422534 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.404819703 podStartE2EDuration="2.422516778s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.697075ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:20.421185689 +0000 UTC m=+158.563674342" watchObservedRunningTime="2026-07-06 14:27:20.422516778 +0000 UTC m=+158.565005402" Jul 06 14:27:21.197608 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197572 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:21.197927 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197888 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="prometheus" containerID="cri-o://d60faf18965007b00e9f7f658ff4d46798b24fb50ce1bc153639f0a73bcbee6b" gracePeriod=600 Jul 06 14:27:21.197927 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197915 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="thanos-sidecar" containerID="cri-o://76e86b5a70c46ff7fa50a4ac0b26015e405a2a95fed45368fb43419f9736f630" gracePeriod=600 Jul 06 14:27:21.198138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197941 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d3f17ef775d0fcf353019cf0c68b0b89c6b4ce0296edf23c62fa0c5bf059d771" gracePeriod=600 Jul 06 14:27:21.198138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197921 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="config-reloader" containerID="cri-o://42f2767952f62d2b48cdb12da3bec76b680e600b7d2eabe2c882cee8f28b46de" gracePeriod=600 Jul 06 14:27:21.198138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197912 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy" containerID="cri-o://ae2057b4b45589354374422c7fc423fae74cb730ba9453db6535700c9644285b" gracePeriod=600 Jul 06 14:27:21.198138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.197993 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-web" containerID="cri-o://49e88c6f9cff351073852a7846a424f7cb453821489e36dc9ac5c911d16b163a" gracePeriod=600 Jul 06 14:27:21.407567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407532 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="d3f17ef775d0fcf353019cf0c68b0b89c6b4ce0296edf23c62fa0c5bf059d771" exitCode=0 Jul 06 14:27:21.407567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407565 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="ae2057b4b45589354374422c7fc423fae74cb730ba9453db6535700c9644285b" exitCode=0 Jul 06 14:27:21.407567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407576 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="49e88c6f9cff351073852a7846a424f7cb453821489e36dc9ac5c911d16b163a" exitCode=0 Jul 06 14:27:21.407567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407584 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="76e86b5a70c46ff7fa50a4ac0b26015e405a2a95fed45368fb43419f9736f630" exitCode=0 Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407595 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="42f2767952f62d2b48cdb12da3bec76b680e600b7d2eabe2c882cee8f28b46de" exitCode=0 Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407603 2578 generic.go:356] "Generic (PLEG): container finished" podID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerID="d60faf18965007b00e9f7f658ff4d46798b24fb50ce1bc153639f0a73bcbee6b" exitCode=0 Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"d3f17ef775d0fcf353019cf0c68b0b89c6b4ce0296edf23c62fa0c5bf059d771"} Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"ae2057b4b45589354374422c7fc423fae74cb730ba9453db6535700c9644285b"} Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"49e88c6f9cff351073852a7846a424f7cb453821489e36dc9ac5c911d16b163a"} Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"76e86b5a70c46ff7fa50a4ac0b26015e405a2a95fed45368fb43419f9736f630"} Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407853 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"42f2767952f62d2b48cdb12da3bec76b680e600b7d2eabe2c882cee8f28b46de"} Jul 06 14:27:21.408131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.407896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"d60faf18965007b00e9f7f658ff4d46798b24fb50ce1bc153639f0a73bcbee6b"} Jul 06 14:27:21.457692 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.457619 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:21.544510 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544482 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544512 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544539 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544566 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544603 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5s5c\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544626 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544657 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544688 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544718 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544752 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544896 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.544989 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544925 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.544993 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545023 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545062 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545067 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545113 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545124 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.545293 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545159 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545816 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545816 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545377 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db\") pod \"db356579-2b48-4ae4-81e0-9dfb49c6c462\" (UID: \"db356579-2b48-4ae4-81e0-9dfb49c6c462\") " Jul 06 14:27:21.545816 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545662 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.545816 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545684 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545307 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545594 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545721 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.545794 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.546759 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.547562 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.547869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.547821 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:27:21.548729 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.548526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c" (OuterVolumeSpecName: "kube-api-access-k5s5c") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "kube-api-access-k5s5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:21.549317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549040 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.549317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549132 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.549317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549228 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config" (OuterVolumeSpecName: "config") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.549492 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549420 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.549590 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549557 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out" (OuterVolumeSpecName: "config-out") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:27:21.549648 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.549628 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.550026 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.550001 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.550112 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.550097 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.550805 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.550751 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:27:21.561229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.561205 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config" (OuterVolumeSpecName: "web-config") pod "db356579-2b48-4ae4-81e0-9dfb49c6c462" (UID: "db356579-2b48-4ae4-81e0-9dfb49c6c462"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:27:21.646188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646149 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646186 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646207 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-configmap-metrics-client-ca\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646224 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-config-out\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646241 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646255 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646270 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-tls-assets\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646284 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-web-config\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646298 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-db\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646313 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-kube-rbac-proxy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646327 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646342 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-grpc-tls\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646355 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646369 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5s5c\" (UniqueName: \"kubernetes.io/projected/db356579-2b48-4ae4-81e0-9dfb49c6c462-kube-api-access-k5s5c\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646762 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646383 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-metrics-client-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646762 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646398 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/db356579-2b48-4ae4-81e0-9dfb49c6c462-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646762 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646413 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-config\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:21.646762 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:21.646427 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db356579-2b48-4ae4-81e0-9dfb49c6c462-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:27:22.415088 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.415044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"db356579-2b48-4ae4-81e0-9dfb49c6c462","Type":"ContainerDied","Data":"01ad98b7b2f5b2a6ccbd9da02b0e9108cd0e59bb7819bdc1d9816fdfe5ed2bae"} Jul 06 14:27:22.415507 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.415192 2578 scope.go:117] "RemoveContainer" containerID="d3f17ef775d0fcf353019cf0c68b0b89c6b4ce0296edf23c62fa0c5bf059d771" Jul 06 14:27:22.415507 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.415275 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.427912 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.427782 2578 scope.go:117] "RemoveContainer" containerID="ae2057b4b45589354374422c7fc423fae74cb730ba9453db6535700c9644285b" Jul 06 14:27:22.435222 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.435202 2578 scope.go:117] "RemoveContainer" containerID="49e88c6f9cff351073852a7846a424f7cb453821489e36dc9ac5c911d16b163a" Jul 06 14:27:22.442852 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.442832 2578 scope.go:117] "RemoveContainer" containerID="76e86b5a70c46ff7fa50a4ac0b26015e405a2a95fed45368fb43419f9736f630" Jul 06 14:27:22.446484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.446459 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:22.453001 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.452905 2578 scope.go:117] "RemoveContainer" containerID="42f2767952f62d2b48cdb12da3bec76b680e600b7d2eabe2c882cee8f28b46de" Jul 06 14:27:22.457304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.457280 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:22.461781 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.461748 2578 scope.go:117] "RemoveContainer" containerID="d60faf18965007b00e9f7f658ff4d46798b24fb50ce1bc153639f0a73bcbee6b" Jul 06 14:27:22.469475 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.469451 2578 scope.go:117] "RemoveContainer" containerID="83363735f51435cf851084e1a4c6e8ec4b1f87f7d8f900ddd6422a682c075f4d" Jul 06 14:27:22.481748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.481722 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:22.482058 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482045 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-thanos" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482060 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-thanos" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482079 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482085 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482094 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="thanos-sidecar" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482100 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="thanos-sidecar" Jul 06 14:27:22.482108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482105 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-web" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482110 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-web" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482121 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="prometheus" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482127 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="prometheus" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482134 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="init-config-reloader" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482139 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="init-config-reloader" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482146 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="config-reloader" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482150 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="config-reloader" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482201 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482208 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="prometheus" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482216 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-thanos" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482222 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="thanos-sidecar" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482229 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="config-reloader" Jul 06 14:27:22.482304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.482235 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" containerName="kube-rbac-proxy-web" Jul 06 14:27:22.487840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.487813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.490858 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.490833 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 14:27:22.491003 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.490978 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-12nl05nohkad2\"" Jul 06 14:27:22.491063 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 14:27:22.491063 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.490982 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 14:27:22.491169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491064 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 14:27:22.491169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 14:27:22.491169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491159 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 14:27:22.491500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491483 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 14:27:22.491550 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491536 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 14:27:22.491596 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491488 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 14:27:22.491650 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c92nn\"" Jul 06 14:27:22.491697 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.491662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 14:27:22.492113 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.492092 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 14:27:22.492659 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.492641 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 14:27:22.494317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.494292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 14:27:22.496908 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.496745 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 14:27:22.502667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.502639 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:22.553751 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.553960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.553959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s727f\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-kube-api-access-s727f\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.554573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.554325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655091 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655091 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655306 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655306 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655306 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655306 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655532 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655532 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655532 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s727f\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-kube-api-access-s727f\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.655980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.656591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.655990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.656591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.656022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.656591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.656063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.656591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.656096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.657743 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.656941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.657743 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.657387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.657743 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.657566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.658285 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.658255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.659581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.659479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.660400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.659902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.660400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.660043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.660400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.660091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.660400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.660093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config-out\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.660966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.660923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-web-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661235 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661349 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661349 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661518 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.661984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.661965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-config\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.665140 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.665120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s727f\" (UniqueName: \"kubernetes.io/projected/95bf0ac1-7277-4555-81fb-e04c1c8f6bda-kube-api-access-s727f\") pod \"prometheus-k8s-0\" (UID: \"95bf0ac1-7277-4555-81fb-e04c1c8f6bda\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.799998 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.799901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:22.940878 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:22.940854 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 14:27:22.943328 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:27:22.943297 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bf0ac1_7277_4555_81fb_e04c1c8f6bda.slice/crio-76a8b55045ac1dc44e7b5b93cdc62008c0e4f7466f9363a169d65ff18c068e0b WatchSource:0}: Error finding container 76a8b55045ac1dc44e7b5b93cdc62008c0e4f7466f9363a169d65ff18c068e0b: Status 404 returned error can't find the container with id 76a8b55045ac1dc44e7b5b93cdc62008c0e4f7466f9363a169d65ff18c068e0b Jul 06 14:27:23.420262 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:23.420222 2578 generic.go:356] "Generic (PLEG): container finished" podID="95bf0ac1-7277-4555-81fb-e04c1c8f6bda" containerID="a7495f8a2ada2ffd52e07e93612652a0e594e16d05a721d6775eee99f1baad51" exitCode=0 Jul 06 14:27:23.420709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:23.420304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerDied","Data":"a7495f8a2ada2ffd52e07e93612652a0e594e16d05a721d6775eee99f1baad51"} Jul 06 14:27:23.420709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:23.420383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"76a8b55045ac1dc44e7b5b93cdc62008c0e4f7466f9363a169d65ff18c068e0b"} Jul 06 14:27:24.428885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.428842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"db52437f90c791340f8c2956048de5e1854bc0de244f2f4d243663f28440cc8b"} Jul 06 14:27:24.429272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.428949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"5bc23a6e8523931f8066d0f94cf4ba5a3e11af77760de4e7c93a562492c56a5d"} Jul 06 14:27:24.429272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.428979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"2fb0596aa468d239e83eeb711b04c9d5a5f8a45e6e6aac0b3e8e44fbb0111eaa"} Jul 06 14:27:24.429272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.429013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"674bcf3be92f8390549525c4a71d47f931f58c0b6dadfb9a77578c85709ff62d"} Jul 06 14:27:24.429272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.429037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"5e9093a17689b2486e9e0b354b1f50a253099acaef49f63cf51d19455cb7acef"} Jul 06 14:27:24.429272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.429064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95bf0ac1-7277-4555-81fb-e04c1c8f6bda","Type":"ContainerStarted","Data":"f72abfc4a7af2e340f4d0cc5a792120c1b25065756b426783c5996677aefd051"} Jul 06 14:27:24.454625 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.454591 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db356579-2b48-4ae4-81e0-9dfb49c6c462" path="/var/lib/kubelet/pods/db356579-2b48-4ae4-81e0-9dfb49c6c462/volumes" Jul 06 14:27:24.477747 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.477686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.457957499 podStartE2EDuration="2.47766468s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.707181ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:24.475219704 +0000 UTC m=+162.617708338" watchObservedRunningTime="2026-07-06 14:27:24.47766468 +0000 UTC m=+162.620153315" Jul 06 14:27:24.602076 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.602047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:24.703885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:24.703800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:27.800421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:27.800371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:27:30.346941 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:30.346906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:30.448093 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:30.448061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:30.519685 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:30.519656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:38.227681 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:38.227640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:38.326984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:38.326923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:57.942675 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:57.942636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:27:58.013706 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:27:58.013678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:05.731314 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:05.731275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:05.832263 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:05.832231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:16.965478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:16.965448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:22.800580 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:22.800542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:28:22.816546 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:22.816523 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:28:23.684008 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:23.683977 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 14:28:32.593714 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:32.593677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:33.379481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:33.379443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:36.203438 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:36.203402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:36.310745 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:36.310714 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:37.816951 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:37.816921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:37.922451 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:37.922405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:38.287097 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:38.287065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:38.386422 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:38.386391 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:40.506062 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:40.506028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:40.694569 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:40.694541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:42.997717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:42.997678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:43.098408 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:43.098375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:46.640583 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:46.640550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:46.739280 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:46.739245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:48.893972 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:48.893943 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:51.403120 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:51.403085 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:51.503669 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:51.503636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:53.307232 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.307199 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j"] Jul 06 14:28:53.309618 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.309594 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.312857 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.312835 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 14:28:53.314099 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.314068 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 14:28:53.314227 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.314137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7wpkg\"" Jul 06 14:28:53.330573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.330548 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j"] Jul 06 14:28:53.347031 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.346996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4m9r\" (UniqueName: \"kubernetes.io/projected/305faa74-4e5f-4b16-8624-b1d04ca42dae-kube-api-access-c4m9r\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.347242 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.347123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/305faa74-4e5f-4b16-8624-b1d04ca42dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.448200 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.448155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4m9r\" (UniqueName: \"kubernetes.io/projected/305faa74-4e5f-4b16-8624-b1d04ca42dae-kube-api-access-c4m9r\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.448872 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.448845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/305faa74-4e5f-4b16-8624-b1d04ca42dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.449505 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.449376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/305faa74-4e5f-4b16-8624-b1d04ca42dae-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.458735 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.458715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4m9r\" (UniqueName: \"kubernetes.io/projected/305faa74-4e5f-4b16-8624-b1d04ca42dae-kube-api-access-c4m9r\") pod \"openshift-lws-operator-fd8ccff4c-ttl4j\" (UID: \"305faa74-4e5f-4b16-8624-b1d04ca42dae\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.636297 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.636218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" Jul 06 14:28:53.776933 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.776907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j"] Jul 06 14:28:53.779424 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:28:53.779383 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod305faa74_4e5f_4b16_8624_b1d04ca42dae.slice/crio-1c7995794107d43e971ff044ffe86531b33c1d85c111ca21645dcfd60133496b WatchSource:0}: Error finding container 1c7995794107d43e971ff044ffe86531b33c1d85c111ca21645dcfd60133496b: Status 404 returned error can't find the container with id 1c7995794107d43e971ff044ffe86531b33c1d85c111ca21645dcfd60133496b Jul 06 14:28:53.789343 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:53.789317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" event={"ID":"305faa74-4e5f-4b16-8624-b1d04ca42dae","Type":"ContainerStarted","Data":"1c7995794107d43e971ff044ffe86531b33c1d85c111ca21645dcfd60133496b"} Jul 06 14:28:56.806851 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:56.806811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" event={"ID":"305faa74-4e5f-4b16-8624-b1d04ca42dae","Type":"ContainerStarted","Data":"09e11991e6ca88fd76e343461d45e58f5623788332293a219cb232aad7e12c90"} Jul 06 14:28:56.829177 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:56.829129 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ttl4j" podStartSLOduration=1.543802332 podStartE2EDuration="3.829112398s" totalImagesPullingTime="2.285310066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:28:56.827432053 +0000 UTC m=+254.969920707" watchObservedRunningTime="2026-07-06 14:28:56.829112398 +0000 UTC m=+254.971601033" Jul 06 14:28:57.474978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:57.474946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:57.573010 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:57.572976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:28:59.611176 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:28:59.611141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.006944 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.006863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.106962 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.106927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.633747 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.633706 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.803786 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.803747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.911713 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.911683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:16.948798 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.948748 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn"] Jul 06 14:29:16.956378 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.956352 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:16.965558 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.965533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 14:29:16.965558 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.965561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 14:29:16.966068 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.966044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 14:29:16.966218 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.966123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 14:29:16.966376 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.966363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qlzj2\"" Jul 06 14:29:16.976679 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:16.976650 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn"] Jul 06 14:29:17.052629 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.052593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-manifests\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.052629 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.052629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftd2\" (UniqueName: \"kubernetes.io/projected/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-kube-api-access-rftd2\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.053103 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.052659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-tmp\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.053103 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.052723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.053103 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.052753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.077386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.077356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.154063 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.154236 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-manifests\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.154278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rftd2\" (UniqueName: \"kubernetes.io/projected/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-kube-api-access-rftd2\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.154312 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-tmp\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.154387 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.154464 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.154421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-manifests\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.156698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.156677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-tmp\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.156837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.156810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.156837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.156820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.175131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.175069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftd2\" (UniqueName: \"kubernetes.io/projected/0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1-kube-api-access-rftd2\") pod \"opendatahub-operator-controller-manager-9447c645c-cjfnn\" (UID: \"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1\") " pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.180719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.180673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.266387 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.266356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:17.276328 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.276301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.377038 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.376920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.446421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.446347 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn"] Jul 06 14:29:17.449265 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:17.449227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c19dd55_b4ef_45fd_b9c1_f84b879bfdc1.slice/crio-7db6312fc3bd0043dd7beda5a22f11b891cee438ea29b60df7c37626335e6aa5 WatchSource:0}: Error finding container 7db6312fc3bd0043dd7beda5a22f11b891cee438ea29b60df7c37626335e6aa5: Status 404 returned error can't find the container with id 7db6312fc3bd0043dd7beda5a22f11b891cee438ea29b60df7c37626335e6aa5 Jul 06 14:29:17.475936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.475901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.583344 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.583312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.676471 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.676438 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.777593 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.777502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.883199 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.883164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:17.891873 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.891834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" event={"ID":"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1","Type":"ContainerStarted","Data":"7db6312fc3bd0043dd7beda5a22f11b891cee438ea29b60df7c37626335e6aa5"} Jul 06 14:29:17.992441 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:17.992413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:20.908662 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:20.908629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" event={"ID":"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1","Type":"ContainerStarted","Data":"265dde94d2edb07eff59c3100561ab697eb41e669b4b6d65901b3c0638bcacc3"} Jul 06 14:29:21.914235 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:21.914201 2578 generic.go:356] "Generic (PLEG): container finished" podID="0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1" containerID="265dde94d2edb07eff59c3100561ab697eb41e669b4b6d65901b3c0638bcacc3" exitCode=0 Jul 06 14:29:21.914592 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:21.914259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" event={"ID":"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1","Type":"ContainerDied","Data":"265dde94d2edb07eff59c3100561ab697eb41e669b4b6d65901b3c0638bcacc3"} Jul 06 14:29:22.920421 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:22.920387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" event={"ID":"0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1","Type":"ContainerStarted","Data":"26408dc6f0ec5d69e2178e0da8d397c95de12ee3c469d13f9e1248141d7391b6"} Jul 06 14:29:22.920810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:22.920539 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:22.955890 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:22.955845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" podStartSLOduration=2.669935342 podStartE2EDuration="6.955830023s" totalImagesPullingTime="3.263776303s" totalInitContainerRuntime="1.022118378s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:22.954554032 +0000 UTC m=+281.097042692" watchObservedRunningTime="2026-07-06 14:29:22.955830023 +0000 UTC m=+281.098318656" Jul 06 14:29:26.388322 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:26.388273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:26.480289 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:26.480261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:28.228446 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:28.228415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:28.334012 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:28.333982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:33.926918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:33.926885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9447c645c-cjfnn" Jul 06 14:29:35.699211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:35.699183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:37.134542 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:37.134512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:37.234343 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:37.234312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:37.339988 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:37.339961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:37.423280 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:37.423247 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:37.753407 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:37.753327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:41.516205 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.516171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:41.638101 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.638069 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d848d496-5d7nh"] Jul 06 14:29:41.642132 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.642105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.644714 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.644692 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 14:29:41.644931 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.644915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 14:29:41.645012 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.644976 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w5lh8\"" Jul 06 14:29:41.646003 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.645986 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 14:29:41.646083 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.646060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 14:29:41.650159 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.649690 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d848d496-5d7nh"] Jul 06 14:29:41.684595 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.684562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:41.780794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.780692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe76766-0b18-4ced-b5c3-56b690e22678-tmp\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.780794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.780731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe76766-0b18-4ced-b5c3-56b690e22678-tls-certs\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.780794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.780751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6bpt\" (UniqueName: \"kubernetes.io/projected/0fe76766-0b18-4ced-b5c3-56b690e22678-kube-api-access-m6bpt\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.881641 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.881606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe76766-0b18-4ced-b5c3-56b690e22678-tmp\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.881641 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.881653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe76766-0b18-4ced-b5c3-56b690e22678-tls-certs\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.881917 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.881671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6bpt\" (UniqueName: \"kubernetes.io/projected/0fe76766-0b18-4ced-b5c3-56b690e22678-kube-api-access-m6bpt\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.884040 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.884013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe76766-0b18-4ced-b5c3-56b690e22678-tmp\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.884154 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.884138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe76766-0b18-4ced-b5c3-56b690e22678-tls-certs\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.892613 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.892590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6bpt\" (UniqueName: \"kubernetes.io/projected/0fe76766-0b18-4ced-b5c3-56b690e22678-kube-api-access-m6bpt\") pod \"kube-auth-proxy-5d848d496-5d7nh\" (UID: \"0fe76766-0b18-4ced-b5c3-56b690e22678\") " pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:41.952878 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:41.952848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" Jul 06 14:29:42.090290 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:42.090268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d848d496-5d7nh"] Jul 06 14:29:42.092251 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:42.092217 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe76766_0b18_4ced_b5c3_56b690e22678.slice/crio-9ff6bd09e69462cf0fadc3ea2029076f5939e1b81ff4ded26782fca97f60b6f8 WatchSource:0}: Error finding container 9ff6bd09e69462cf0fadc3ea2029076f5939e1b81ff4ded26782fca97f60b6f8: Status 404 returned error can't find the container with id 9ff6bd09e69462cf0fadc3ea2029076f5939e1b81ff4ded26782fca97f60b6f8 Jul 06 14:29:42.275364 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:42.275335 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 14:29:42.975237 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:42.975203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:43.008666 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:43.008628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" event={"ID":"0fe76766-0b18-4ced-b5c3-56b690e22678","Type":"ContainerStarted","Data":"9ff6bd09e69462cf0fadc3ea2029076f5939e1b81ff4ded26782fca97f60b6f8"} Jul 06 14:29:43.084397 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:43.084369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:44.401188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.401154 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4"] Jul 06 14:29:44.405365 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.405341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.411623 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.411596 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 14:29:44.411821 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.411790 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-htqht\"" Jul 06 14:29:44.411821 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.411812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 14:29:44.411967 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.411830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 14:29:44.430538 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.430504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4"] Jul 06 14:29:44.507039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.506993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgz4f\" (UniqueName: \"kubernetes.io/projected/c148f003-4a56-4766-932e-ea897793493a-kube-api-access-xgz4f\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.507229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.507041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-metrics-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.507229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.507134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c148f003-4a56-4766-932e-ea897793493a-manager-config\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.507229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.507204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.538839 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.538804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:44.607873 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.607837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c148f003-4a56-4766-932e-ea897793493a-manager-config\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.608064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.607924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.608064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.608043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgz4f\" (UniqueName: \"kubernetes.io/projected/c148f003-4a56-4766-932e-ea897793493a-kube-api-access-xgz4f\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.608186 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.608071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-metrics-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.608840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.608634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c148f003-4a56-4766-932e-ea897793493a-manager-config\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.616593 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.616534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.617553 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.617529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c148f003-4a56-4766-932e-ea897793493a-metrics-cert\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.620304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.620278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgz4f\" (UniqueName: \"kubernetes.io/projected/c148f003-4a56-4766-932e-ea897793493a-kube-api-access-xgz4f\") pod \"lws-controller-manager-5b6868f88d-mvbj4\" (UID: \"c148f003-4a56-4766-932e-ea897793493a\") " pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.718402 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.718373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:44.888807 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.888783 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 14:29:44.971087 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.971065 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4"] Jul 06 14:29:44.973566 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:44.973535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc148f003_4a56_4766_932e_ea897793493a.slice/crio-0dfe500239861100da656945cbf64251b1dd04c24e2b0b6daea6ab584a74f10b WatchSource:0}: Error finding container 0dfe500239861100da656945cbf64251b1dd04c24e2b0b6daea6ab584a74f10b: Status 404 returned error can't find the container with id 0dfe500239861100da656945cbf64251b1dd04c24e2b0b6daea6ab584a74f10b Jul 06 14:29:44.975711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:44.975695 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:29:45.018639 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:45.018604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" event={"ID":"c148f003-4a56-4766-932e-ea897793493a","Type":"ContainerStarted","Data":"0dfe500239861100da656945cbf64251b1dd04c24e2b0b6daea6ab584a74f10b"} Jul 06 14:29:45.020047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:45.020025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" event={"ID":"0fe76766-0b18-4ced-b5c3-56b690e22678","Type":"ContainerStarted","Data":"f07d928b2ca481199dfe06492ac70a735e42b1371ae1aebcfdade459c64b126f"} Jul 06 14:29:45.051884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:45.051835 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d848d496-5d7nh" podStartSLOduration=1.259962929 podStartE2EDuration="4.051816172s" totalImagesPullingTime="2.791853243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:45.051009766 +0000 UTC m=+303.193498413" watchObservedRunningTime="2026-07-06 14:29:45.051816172 +0000 UTC m=+303.194304805" Jul 06 14:29:47.030696 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.030662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" event={"ID":"c148f003-4a56-4766-932e-ea897793493a","Type":"ContainerStarted","Data":"73a8a28100e4388ced21f5512bf5fdf810793ea6253cfc7a49d9574be3e55ac5"} Jul 06 14:29:47.031093 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.030795 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:47.271243 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.271213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.403299 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.403213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.500873 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.500835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.544357 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.540992 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" podStartSLOduration=2.212171537 podStartE2EDuration="3.540973023s" totalImagesPullingTime="1.328801486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:47.254814255 +0000 UTC m=+305.397302888" watchObservedRunningTime="2026-07-06 14:29:47.540973023 +0000 UTC m=+305.683461660" Jul 06 14:29:47.544357 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.542695 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wps4"] Jul 06 14:29:47.547099 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.547068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.549578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.549553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 14:29:47.549716 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.549615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9v26h\"" Jul 06 14:29:47.552656 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.552630 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4"] Jul 06 14:29:47.557186 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.556233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.559203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.559168 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 14:29:47.559465 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.559448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zhwpl\"" Jul 06 14:29:47.559579 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.559556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wps4"] Jul 06 14:29:47.583108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.583069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4"] Jul 06 14:29:47.606589 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.606559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.645865 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.645825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccqn\" (UniqueName: \"kubernetes.io/projected/3d02cf08-3cdf-4197-83de-54d5bece5e6c-kube-api-access-lccqn\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.646047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.645897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.646047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.645922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w829x\" (UniqueName: \"kubernetes.io/projected/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-kube-api-access-w829x\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.646047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.645939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d02cf08-3cdf-4197-83de-54d5bece5e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.707776 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.707736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.746412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.746370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccqn\" (UniqueName: \"kubernetes.io/projected/3d02cf08-3cdf-4197-83de-54d5bece5e6c-kube-api-access-lccqn\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.746564 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.746465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.746564 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.746494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w829x\" (UniqueName: \"kubernetes.io/projected/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-kube-api-access-w829x\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.746564 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.746520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d02cf08-3cdf-4197-83de-54d5bece5e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.746706 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:29:47.746592 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 06 14:29:47.746706 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:29:47.746661 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert podName:3481cd65-d9b3-49e9-9fde-e8d3c7d736c6 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:48.246639258 +0000 UTC m=+306.389127873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert") pod "kserve-controller-manager-d6f4b65b8-7wps4" (UID: "3481cd65-d9b3-49e9-9fde-e8d3c7d736c6") : secret "kserve-webhook-server-cert" not found Jul 06 14:29:47.749720 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.749691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d02cf08-3cdf-4197-83de-54d5bece5e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.759141 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.759111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccqn\" (UniqueName: \"kubernetes.io/projected/3d02cf08-3cdf-4197-83de-54d5bece5e6c-kube-api-access-lccqn\") pod \"llmisvc-controller-manager-777c6bd7d5-gm7l4\" (UID: \"3d02cf08-3cdf-4197-83de-54d5bece5e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:47.759469 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.759449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w829x\" (UniqueName: \"kubernetes.io/projected/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-kube-api-access-w829x\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:47.872113 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.872084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:47.873039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:47.873022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:48.050496 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.050420 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4"] Jul 06 14:29:48.053482 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:48.053450 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d02cf08_3cdf_4197_83de_54d5bece5e6c.slice/crio-d41a76bff514d2fe2a865cbe814ba7ac42414e82e3736f3dace8c42b69ee3094 WatchSource:0}: Error finding container d41a76bff514d2fe2a865cbe814ba7ac42414e82e3736f3dace8c42b69ee3094: Status 404 returned error can't find the container with id d41a76bff514d2fe2a865cbe814ba7ac42414e82e3736f3dace8c42b69ee3094 Jul 06 14:29:48.251400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.251369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:48.253845 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.253823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3481cd65-d9b3-49e9-9fde-e8d3c7d736c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-7wps4\" (UID: \"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:48.463991 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.463963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:48.669523 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.669500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7wps4"] Jul 06 14:29:48.672549 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:48.672522 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3481cd65_d9b3_49e9_9fde_e8d3c7d736c6.slice/crio-d85efb5b9b440a0c3eb63fef0fd2f1fdc4a4c8e0f1d452d113b8619c7aad6d55 WatchSource:0}: Error finding container d85efb5b9b440a0c3eb63fef0fd2f1fdc4a4c8e0f1d452d113b8619c7aad6d55: Status 404 returned error can't find the container with id d85efb5b9b440a0c3eb63fef0fd2f1fdc4a4c8e0f1d452d113b8619c7aad6d55 Jul 06 14:29:48.712610 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.712574 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr"] Jul 06 14:29:48.732136 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.732065 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr"] Jul 06 14:29:48.732271 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.732165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.735410 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.735387 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-chtl2\"" Jul 06 14:29:48.735543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.735388 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 14:29:48.749688 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.749622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:48.756860 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.756826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-kube-api-access-lrl6r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.756860 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.756860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757054 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.756883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757054 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.756985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757054 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.757038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.757085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.757102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.757120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.757214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.757143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858511 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858511 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.858723 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859084 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.858746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-kube-api-access-lrl6r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859084 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.859053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859192 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.859091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859279 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.859230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859407 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.859281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.859407 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.859265 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.861048 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.861029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.861321 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.861302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.870159 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.870140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:48.875560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:48.875536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrl6r\" (UniqueName: \"kubernetes.io/projected/8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0-kube-api-access-lrl6r\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42l6hr\" (UID: \"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:49.025346 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.025271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.042972 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.042937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:49.043667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.043640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" event={"ID":"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6","Type":"ContainerStarted","Data":"d85efb5b9b440a0c3eb63fef0fd2f1fdc4a4c8e0f1d452d113b8619c7aad6d55"} Jul 06 14:29:49.044872 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.044846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" event={"ID":"3d02cf08-3cdf-4197-83de-54d5bece5e6c","Type":"ContainerStarted","Data":"d41a76bff514d2fe2a865cbe814ba7ac42414e82e3736f3dace8c42b69ee3094"} Jul 06 14:29:49.209376 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.209345 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr"] Jul 06 14:29:49.212453 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:29:49.212422 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff1a6ab_56ff_4c2c_be8b_fb4bb11531e0.slice/crio-abfbdc2758879e819b1bcff12446db1150a0ea7d53390078f06c4f0ff9b00391 WatchSource:0}: Error finding container abfbdc2758879e819b1bcff12446db1150a0ea7d53390078f06c4f0ff9b00391: Status 404 returned error can't find the container with id abfbdc2758879e819b1bcff12446db1150a0ea7d53390078f06c4f0ff9b00391 Jul 06 14:29:49.384542 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.384455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.850230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.850201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:49.992193 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:49.992152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:50.054881 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:50.054841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" event={"ID":"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0","Type":"ContainerStarted","Data":"abfbdc2758879e819b1bcff12446db1150a0ea7d53390078f06c4f0ff9b00391"} Jul 06 14:29:52.840405 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:52.840374 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:29:52.840829 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:52.840439 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:29:52.840829 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:52.840468 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:29:53.074916 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.074817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" event={"ID":"3d02cf08-3cdf-4197-83de-54d5bece5e6c","Type":"ContainerStarted","Data":"74e880147155ee6b10ff2dabb6e5e96d93ff8b8a41bbb76427cabdeaf1f72ee9"} Jul 06 14:29:53.075076 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.074949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:29:53.076445 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.076419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" event={"ID":"3481cd65-d9b3-49e9-9fde-e8d3c7d736c6","Type":"ContainerStarted","Data":"94e8c877af2d25fc780b4edbe8e0a261b4987909e4a642587ec8140f88f95268"} Jul 06 14:29:53.076583 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.076550 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:29:53.077917 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.077898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" event={"ID":"8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0","Type":"ContainerStarted","Data":"312c7233d552a8948d3b0902518b579013d50ec2f1470a406397f65a46ff5b0a"} Jul 06 14:29:53.094463 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.094423 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" podStartSLOduration=1.313016669 podStartE2EDuration="6.094410475s" totalImagesPullingTime="4.781393806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:53.093101635 +0000 UTC m=+311.235590296" watchObservedRunningTime="2026-07-06 14:29:53.094410475 +0000 UTC m=+311.236899109" Jul 06 14:29:53.116072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.116020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" podStartSLOduration=1.490585826 podStartE2EDuration="5.116002906s" totalImagesPullingTime="3.62541708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:53.114327993 +0000 UTC m=+311.256816641" watchObservedRunningTime="2026-07-06 14:29:53.116002906 +0000 UTC m=+311.258491541" Jul 06 14:29:53.133631 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:53.133573 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" podStartSLOduration=1.966666706 podStartE2EDuration="6.133553402s" totalImagesPullingTime="4.166886696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:53.133260278 +0000 UTC m=+311.275748920" watchObservedRunningTime="2026-07-06 14:29:53.133553402 +0000 UTC m=+311.276042038" Jul 06 14:29:54.043921 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:54.043885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:54.048395 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:54.048365 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:54.082937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:54.082912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:54.083759 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:54.083743 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42l6hr" Jul 06 14:29:58.038012 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:58.037981 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b6868f88d-mvbj4" Jul 06 14:29:58.739927 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:58.739899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:29:58.813260 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:29:58.813229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:00.598738 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:00.598707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:00.735127 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:00.735081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.150978 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:02.150946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:02.247025 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:02.246995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.247810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:23.247749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:23.347984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:23.347944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:24.085211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:24.085173 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gm7l4" Jul 06 14:30:24.088241 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:24.088217 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7wps4" Jul 06 14:30:37.212997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:37.212962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:37.311798 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:37.311749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:30:37.410308 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:30:37.410276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:06.251419 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:06.251382 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:06.846415 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:06.846380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:07.899397 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:07.899367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:11.046656 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:11.046625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:14.737997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:14.737949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:15.526604 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:15.526568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:17.487498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:17.487439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:17.718454 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:17.718422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:20.100793 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:20.100741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:21.253835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:21.253795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:21.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:21.326296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:21.667052 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:21.667012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:21.745581 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:21.745535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:21.920739 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:21.920655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:25.531442 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:25.531406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:25.632478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:25.632439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:32.351014 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:32.350979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:32.447524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:32.447494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:37.091693 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:37.091661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:37.211278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:37.211249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:40.857670 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:40.857633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:40.958029 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:40.957993 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:41.070995 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:41.070957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:41.175062 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:41.175034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:43.658963 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:43.658931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:43.759307 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:43.759272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:48.361498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:48.361454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:50.234232 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:50.234197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:50.342197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:50.342161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:54.795826 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:54.795792 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:54.897617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:54.897578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:55.040016 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:55.039959 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:58.907719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:58.907685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:59.010096 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:59.010064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:59.511164 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:59.511127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:31:59.612137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:31:59.612110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:03.096596 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:03.096522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:03.170441 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:03.170384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:09.205647 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:09.205617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:09.306005 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:09.305975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:13.258399 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:13.258338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:13.442936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:13.442904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:13.901365 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:13.901332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:14.003577 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:14.003540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:28.638144 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:28.638108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:28.741101 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:28.741073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:28.817331 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:28.817308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:29.543381 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.543353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:29.636030 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.635999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:32:29.639749 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.639727 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:32:29.643197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.643183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:32:29.649175 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.649150 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6n5zb\"" Jul 06 14:32:29.650707 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.650684 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:32:29.651624 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.651602 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 14:32:29.651799 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.651608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 14:32:29.819362 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.819281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccpx\" (UniqueName: \"kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx\") pod \"authorino-75d556bd77-rvtnk\" (UID: \"44a4e519-e883-46d1-af17-475bac81dbad\") " pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:32:29.920331 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.920289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccpx\" (UniqueName: \"kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx\") pod \"authorino-75d556bd77-rvtnk\" (UID: \"44a4e519-e883-46d1-af17-475bac81dbad\") " pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:32:29.931211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.931182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccpx\" (UniqueName: \"kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx\") pod \"authorino-75d556bd77-rvtnk\" (UID: \"44a4e519-e883-46d1-af17-475bac81dbad\") " pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:32:29.952553 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:29.952514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:32:30.085918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:30.085861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:32:30.088120 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:32:30.088090 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44a4e519_e883_46d1_af17_475bac81dbad.slice/crio-80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a WatchSource:0}: Error finding container 80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a: Status 404 returned error can't find the container with id 80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a Jul 06 14:32:30.827194 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:30.827154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvtnk" event={"ID":"44a4e519-e883-46d1-af17-475bac81dbad","Type":"ContainerStarted","Data":"80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a"} Jul 06 14:32:33.845001 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:33.844962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvtnk" event={"ID":"44a4e519-e883-46d1-af17-475bac81dbad","Type":"ContainerStarted","Data":"f6249b8a0489226c2d6f597deb15da77d2442e07e92f923646a205f3bfedf7ed"} Jul 06 14:32:33.863614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:33.863567 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rvtnk" podStartSLOduration=1.74691814 podStartE2EDuration="4.863551464s" totalImagesPullingTime="3.116633324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:32:33.86170999 +0000 UTC m=+472.004198645" watchObservedRunningTime="2026-07-06 14:32:33.863551464 +0000 UTC m=+472.006040116" Jul 06 14:32:50.872373 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:32:50.872340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:02.433498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:02.433462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:02.506947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:02.506907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:03.477017 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:03.476983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:03.907521 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:03.907489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:03.980027 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:03.979995 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:03.982493 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:03.982472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:03.993029 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:03.993009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:04.124826 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.124783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w88gp\" (UniqueName: \"kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp\") pod \"authorino-9c7bb66b8-zww5j\" (UID: \"0586b2d3-cf16-4fea-9a18-499051cdc624\") " pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:04.225543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.225457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w88gp\" (UniqueName: \"kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp\") pod \"authorino-9c7bb66b8-zww5j\" (UID: \"0586b2d3-cf16-4fea-9a18-499051cdc624\") " pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:04.239076 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.239042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w88gp\" (UniqueName: \"kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp\") pod \"authorino-9c7bb66b8-zww5j\" (UID: \"0586b2d3-cf16-4fea-9a18-499051cdc624\") " pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:04.292342 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.292307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:04.397116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.397080 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:04.432937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.432892 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:04.435724 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:33:04.435687 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0586b2d3_cf16_4fea_9a18_499051cdc624.slice/crio-d3f7679322a2b4dd9d6adcd829ef1e400c4b8b79261c50bb87bf8a0616fdac04 WatchSource:0}: Error finding container d3f7679322a2b4dd9d6adcd829ef1e400c4b8b79261c50bb87bf8a0616fdac04: Status 404 returned error can't find the container with id d3f7679322a2b4dd9d6adcd829ef1e400c4b8b79261c50bb87bf8a0616fdac04 Jul 06 14:33:04.993731 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.993695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" event={"ID":"0586b2d3-cf16-4fea-9a18-499051cdc624","Type":"ContainerStarted","Data":"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144"} Jul 06 14:33:04.993731 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.993739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" event={"ID":"0586b2d3-cf16-4fea-9a18-499051cdc624","Type":"ContainerStarted","Data":"d3f7679322a2b4dd9d6adcd829ef1e400c4b8b79261c50bb87bf8a0616fdac04"} Jul 06 14:33:04.993731 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:04.993699 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" podUID="0586b2d3-cf16-4fea-9a18-499051cdc624" containerName="authorino" containerID="cri-o://2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144" gracePeriod=30 Jul 06 14:33:05.012349 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.012304 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" podStartSLOduration=1.683151453 podStartE2EDuration="2.012287762s" totalImagesPullingTime="329.136309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:05.010702677 +0000 UTC m=+503.153191330" watchObservedRunningTime="2026-07-06 14:33:05.012287762 +0000 UTC m=+503.154776396" Jul 06 14:33:05.224338 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.224316 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:05.335870 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.335835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w88gp\" (UniqueName: \"kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp\") pod \"0586b2d3-cf16-4fea-9a18-499051cdc624\" (UID: \"0586b2d3-cf16-4fea-9a18-499051cdc624\") " Jul 06 14:33:05.338131 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.338105 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp" (OuterVolumeSpecName: "kube-api-access-w88gp") pod "0586b2d3-cf16-4fea-9a18-499051cdc624" (UID: "0586b2d3-cf16-4fea-9a18-499051cdc624"). InnerVolumeSpecName "kube-api-access-w88gp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:33:05.436468 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.436433 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w88gp\" (UniqueName: \"kubernetes.io/projected/0586b2d3-cf16-4fea-9a18-499051cdc624-kube-api-access-w88gp\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:33:05.749838 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.749736 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:33:05.749985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:05.749933 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rvtnk" podUID="44a4e519-e883-46d1-af17-475bac81dbad" containerName="authorino" containerID="cri-o://f6249b8a0489226c2d6f597deb15da77d2442e07e92f923646a205f3bfedf7ed" gracePeriod=30 Jul 06 14:33:06.001446 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.001369 2578 generic.go:356] "Generic (PLEG): container finished" podID="44a4e519-e883-46d1-af17-475bac81dbad" containerID="f6249b8a0489226c2d6f597deb15da77d2442e07e92f923646a205f3bfedf7ed" exitCode=0 Jul 06 14:33:06.001893 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.001441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvtnk" event={"ID":"44a4e519-e883-46d1-af17-475bac81dbad","Type":"ContainerDied","Data":"f6249b8a0489226c2d6f597deb15da77d2442e07e92f923646a205f3bfedf7ed"} Jul 06 14:33:06.001893 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.001488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvtnk" event={"ID":"44a4e519-e883-46d1-af17-475bac81dbad","Type":"ContainerDied","Data":"80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a"} Jul 06 14:33:06.001893 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.001505 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80f293212a513dcb27eb49d8e6f90341fac1013257d390da78b0b352b03ba49a" Jul 06 14:33:06.002785 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.002749 2578 generic.go:356] "Generic (PLEG): container finished" podID="0586b2d3-cf16-4fea-9a18-499051cdc624" containerID="2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144" exitCode=0 Jul 06 14:33:06.002894 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.002806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" event={"ID":"0586b2d3-cf16-4fea-9a18-499051cdc624","Type":"ContainerDied","Data":"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144"} Jul 06 14:33:06.002894 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.002836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" event={"ID":"0586b2d3-cf16-4fea-9a18-499051cdc624","Type":"ContainerDied","Data":"d3f7679322a2b4dd9d6adcd829ef1e400c4b8b79261c50bb87bf8a0616fdac04"} Jul 06 14:33:06.002894 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.002858 2578 scope.go:117] "RemoveContainer" containerID="2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144" Jul 06 14:33:06.002894 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.002858 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c7bb66b8-zww5j" Jul 06 14:33:06.004760 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.004741 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:33:06.011627 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.011528 2578 scope.go:117] "RemoveContainer" containerID="2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144" Jul 06 14:33:06.011899 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:33:06.011880 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144\": container with ID starting with 2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144 not found: ID does not exist" containerID="2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144" Jul 06 14:33:06.011960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.011911 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144"} err="failed to get container status \"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144\": rpc error: code = NotFound desc = could not find container \"2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144\": container with ID starting with 2758fa79a91a458b5e887662770323a41b15f7a141c7f767769638a5492c2144 not found: ID does not exist" Jul 06 14:33:06.039448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.039420 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:06.042252 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.042230 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9c7bb66b8-zww5j"] Jul 06 14:33:06.144151 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.144121 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sccpx\" (UniqueName: \"kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx\") pod \"44a4e519-e883-46d1-af17-475bac81dbad\" (UID: \"44a4e519-e883-46d1-af17-475bac81dbad\") " Jul 06 14:33:06.146307 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.146275 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx" (OuterVolumeSpecName: "kube-api-access-sccpx") pod "44a4e519-e883-46d1-af17-475bac81dbad" (UID: "44a4e519-e883-46d1-af17-475bac81dbad"). InnerVolumeSpecName "kube-api-access-sccpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:33:06.244979 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.244953 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sccpx\" (UniqueName: \"kubernetes.io/projected/44a4e519-e883-46d1-af17-475bac81dbad-kube-api-access-sccpx\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:33:06.455533 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:06.455500 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0586b2d3-cf16-4fea-9a18-499051cdc624" path="/var/lib/kubelet/pods/0586b2d3-cf16-4fea-9a18-499051cdc624/volumes" Jul 06 14:33:07.008305 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:07.008273 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvtnk" Jul 06 14:33:07.029247 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:07.029221 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:33:07.039636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:07.039606 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvtnk"] Jul 06 14:33:08.218558 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:08.218528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:08.318379 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:08.318347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:08.455358 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:08.455328 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44a4e519-e883-46d1-af17-475bac81dbad" path="/var/lib/kubelet/pods/44a4e519-e883-46d1-af17-475bac81dbad/volumes" Jul 06 14:33:10.152295 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.152262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:10.256835 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.256804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:10.353233 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.353203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:10.357502 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.357476 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:33:10.357925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.357906 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a4e519-e883-46d1-af17-475bac81dbad" containerName="authorino" Jul 06 14:33:10.357984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.357928 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a4e519-e883-46d1-af17-475bac81dbad" containerName="authorino" Jul 06 14:33:10.357984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.357948 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0586b2d3-cf16-4fea-9a18-499051cdc624" containerName="authorino" Jul 06 14:33:10.357984 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.357958 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0586b2d3-cf16-4fea-9a18-499051cdc624" containerName="authorino" Jul 06 14:33:10.358123 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.358034 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0586b2d3-cf16-4fea-9a18-499051cdc624" containerName="authorino" Jul 06 14:33:10.358123 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.358046 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a4e519-e883-46d1-af17-475bac81dbad" containerName="authorino" Jul 06 14:33:10.368269 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.368236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.370197 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.370166 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:33:10.372391 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.372366 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-znnsl\"" Jul 06 14:33:10.372522 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.372390 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 14:33:10.372522 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.372370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 14:33:10.482870 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.482840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.483023 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.482894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7snp\" (UniqueName: \"kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.583674 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.583639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.583859 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.583699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7snp\" (UniqueName: \"kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.586245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.586223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.593639 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.593611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7snp\" (UniqueName: \"kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp\") pod \"maas-controller-6746c9cb6f-cjhss\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.679728 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.679689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:10.821550 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:10.821528 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:33:10.823758 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:33:10.823721 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f94a900_4406_4c07_8106_3a7120697df5.slice/crio-bd1c7d75982c1b2d0e722cc41f52fad58f55fe4fac6a834b72200f42ba704c14 WatchSource:0}: Error finding container bd1c7d75982c1b2d0e722cc41f52fad58f55fe4fac6a834b72200f42ba704c14: Status 404 returned error can't find the container with id bd1c7d75982c1b2d0e722cc41f52fad58f55fe4fac6a834b72200f42ba704c14 Jul 06 14:33:11.028853 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:11.028748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" event={"ID":"5f94a900-4406-4c07-8106-3a7120697df5","Type":"ContainerStarted","Data":"bd1c7d75982c1b2d0e722cc41f52fad58f55fe4fac6a834b72200f42ba704c14"} Jul 06 14:33:13.264320 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:13.264283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:13.366277 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:13.366240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:14.046743 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:14.046706 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" event={"ID":"5f94a900-4406-4c07-8106-3a7120697df5","Type":"ContainerStarted","Data":"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab"} Jul 06 14:33:14.068337 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:14.068278 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" podStartSLOduration=1.745142464 podStartE2EDuration="4.068262407s" totalImagesPullingTime="2.323119943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:14.066735396 +0000 UTC m=+512.209224029" watchObservedRunningTime="2026-07-06 14:33:14.068262407 +0000 UTC m=+512.210751043" Jul 06 14:33:15.051478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:15.051453 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:18.337371 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:18.337324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:18.407347 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:18.407317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:26.063526 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:26.063494 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:33:39.756710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:39.756677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:39.856874 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:39.856843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:41.049881 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:41.049843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:46.170588 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:46.170549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:46.726720 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:46.726687 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:47.259466 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:47.259400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:47.374413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:47.374372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:57.712501 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:57.712442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:33:57.809233 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:33:57.809202 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:01.664960 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:01.664927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:11.180932 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:11.180892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:11.281229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:11.281199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:13.510946 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.510915 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v"] Jul 06 14:34:13.514040 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.514021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.517966 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.517935 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 14:34:13.518092 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.517995 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sg57q\"" Jul 06 14:34:13.518092 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.518036 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 14:34:13.518226 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.518117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 14:34:13.529129 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.529105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v"] Jul 06 14:34:13.560794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.560736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:13.663926 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.663894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.664118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.663950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.664118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.664027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.664118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.664058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.664118 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.664085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60948a81-86a4-4c7b-9284-8ad45588b834-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.664288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.664179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdwpj\" (UniqueName: \"kubernetes.io/projected/60948a81-86a4-4c7b-9284-8ad45588b834-kube-api-access-hdwpj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60948a81-86a4-4c7b-9284-8ad45588b834-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765944 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdwpj\" (UniqueName: \"kubernetes.io/projected/60948a81-86a4-4c7b-9284-8ad45588b834-kube-api-access-hdwpj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.765944 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.765645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.766034 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.766004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.766072 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.766048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.766143 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.766125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.767998 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.767974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60948a81-86a4-4c7b-9284-8ad45588b834-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.768239 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.768221 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60948a81-86a4-4c7b-9284-8ad45588b834-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.775250 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.775229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdwpj\" (UniqueName: \"kubernetes.io/projected/60948a81-86a4-4c7b-9284-8ad45588b834-kube-api-access-hdwpj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v\" (UID: \"60948a81-86a4-4c7b-9284-8ad45588b834\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.824919 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.824875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:13.962914 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:13.962889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v"] Jul 06 14:34:13.964845 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:34:13.964815 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60948a81_86a4_4c7b_9284_8ad45588b834.slice/crio-2939f14f8fd98e6b73b3c8f5ce2243998d34e77205e7031d853881e68a22be6a WatchSource:0}: Error finding container 2939f14f8fd98e6b73b3c8f5ce2243998d34e77205e7031d853881e68a22be6a: Status 404 returned error can't find the container with id 2939f14f8fd98e6b73b3c8f5ce2243998d34e77205e7031d853881e68a22be6a Jul 06 14:34:14.337501 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:14.337456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" event={"ID":"60948a81-86a4-4c7b-9284-8ad45588b834","Type":"ContainerStarted","Data":"2939f14f8fd98e6b73b3c8f5ce2243998d34e77205e7031d853881e68a22be6a"} Jul 06 14:34:15.350169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:15.350079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" event={"ID":"60948a81-86a4-4c7b-9284-8ad45588b834","Type":"ContainerStarted","Data":"e3890a37750fbd3f7d0d92a467c7be23056493aef8c264608800c6519ea99f92"} Jul 06 14:34:15.371904 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:15.371846 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" podStartSLOduration=1.3126242879999999 podStartE2EDuration="2.371828775s" totalImagesPullingTime="1.059204487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:34:15.37032443 +0000 UTC m=+573.512813063" watchObservedRunningTime="2026-07-06 14:34:15.371828775 +0000 UTC m=+573.514317408" Jul 06 14:34:23.825411 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:23.825374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:23.825898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:23.825453 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:23.837927 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:23.837899 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:24.409834 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:24.409807 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v" Jul 06 14:34:30.295216 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:30.295184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:35.193992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.193955 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc"] Jul 06 14:34:35.200446 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.200415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.203525 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.203500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 14:34:35.203819 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.203793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc"] Jul 06 14:34:35.224198 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.224174 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:35.262417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.262417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bdw\" (UniqueName: \"kubernetes.io/projected/41021cc1-dcbf-44e6-b4a9-e74fede81c95-kube-api-access-w7bdw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.262644 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.262644 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.262644 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.262644 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.262593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363520 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363711 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363951 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bdw\" (UniqueName: \"kubernetes.io/projected/41021cc1-dcbf-44e6-b4a9-e74fede81c95-kube-api-access-w7bdw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.363951 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.363918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.364234 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.364203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.364234 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.364224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.366064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.366042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41021cc1-dcbf-44e6-b4a9-e74fede81c95-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.366572 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.366553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41021cc1-dcbf-44e6-b4a9-e74fede81c95-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.373337 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.373310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bdw\" (UniqueName: \"kubernetes.io/projected/41021cc1-dcbf-44e6-b4a9-e74fede81c95-kube-api-access-w7bdw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fmnbc\" (UID: \"41021cc1-dcbf-44e6-b4a9-e74fede81c95\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.512295 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.512209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:35.654736 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:35.654710 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc"] Jul 06 14:34:35.656548 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:34:35.656512 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41021cc1_dcbf_44e6_b4a9_e74fede81c95.slice/crio-bb608c41da50381c766f11a3c3e9c465f4b8004ab0e86146c19e7bd2f9a1888b WatchSource:0}: Error finding container bb608c41da50381c766f11a3c3e9c465f4b8004ab0e86146c19e7bd2f9a1888b: Status 404 returned error can't find the container with id bb608c41da50381c766f11a3c3e9c465f4b8004ab0e86146c19e7bd2f9a1888b Jul 06 14:34:36.457515 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:36.457483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" event={"ID":"41021cc1-dcbf-44e6-b4a9-e74fede81c95","Type":"ContainerStarted","Data":"f0ddbb13334139a0ac3ec6e8d29c86e97d0cacc2df768a2ad501394255f276e2"} Jul 06 14:34:36.457911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:36.457527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" event={"ID":"41021cc1-dcbf-44e6-b4a9-e74fede81c95","Type":"ContainerStarted","Data":"bb608c41da50381c766f11a3c3e9c465f4b8004ab0e86146c19e7bd2f9a1888b"} Jul 06 14:34:36.482430 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:36.482379 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" podStartSLOduration=1.197585078 podStartE2EDuration="1.482365477s" totalImagesPullingTime="284.780399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:34:36.479722608 +0000 UTC m=+594.622211243" watchObservedRunningTime="2026-07-06 14:34:36.482365477 +0000 UTC m=+594.624854111" Jul 06 14:34:40.821104 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:40.821069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:45.018325 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:45.018294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:34:45.513237 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:45.513206 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:45.513409 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:45.513283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:45.525704 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:45.525675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:34:46.517859 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:34:46.517831 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fmnbc" Jul 06 14:35:01.597358 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.597322 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn"] Jul 06 14:35:01.600006 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.599983 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.602832 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.602811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 14:35:01.614164 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.614138 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn"] Jul 06 14:35:01.615906 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.615874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.616065 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.615907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdj6s\" (UniqueName: \"kubernetes.io/projected/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-kube-api-access-cdj6s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.616065 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.615935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.616065 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.616035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.616386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.616150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.616386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.616191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717362 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717534 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdj6s\" (UniqueName: \"kubernetes.io/projected/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-kube-api-access-cdj6s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717534 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717534 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717752 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717752 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.717909 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.718045 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.718156 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.717979 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.719629 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.719605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.720121 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.720096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.730046 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.730015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdj6s\" (UniqueName: \"kubernetes.io/projected/fedb53b1-cacd-4945-8e0f-cc4730a69ab9-kube-api-access-cdj6s\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn\" (UID: \"fedb53b1-cacd-4945-8e0f-cc4730a69ab9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:01.756621 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.756588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:01.910543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:01.910517 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:02.053010 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:02.052986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn"] Jul 06 14:35:02.055157 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:35:02.055134 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfedb53b1_cacd_4945_8e0f_cc4730a69ab9.slice/crio-8412e931be8dc5aaa6641964592e23dd655baa645d1cadf7d8a1277376528345 WatchSource:0}: Error finding container 8412e931be8dc5aaa6641964592e23dd655baa645d1cadf7d8a1277376528345: Status 404 returned error can't find the container with id 8412e931be8dc5aaa6641964592e23dd655baa645d1cadf7d8a1277376528345 Jul 06 14:35:02.056468 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:02.056450 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:35:02.585909 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:02.585819 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" event={"ID":"fedb53b1-cacd-4945-8e0f-cc4730a69ab9","Type":"ContainerStarted","Data":"08d61f17cc2b4755f6254f0b003de815de4bf8c9148bc6ffd8d3918256a06a9e"} Jul 06 14:35:02.585909 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:02.585859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" event={"ID":"fedb53b1-cacd-4945-8e0f-cc4730a69ab9","Type":"ContainerStarted","Data":"8412e931be8dc5aaa6641964592e23dd655baa645d1cadf7d8a1277376528345"} Jul 06 14:35:02.613094 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:02.613002 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" podStartSLOduration=1.396859118 podStartE2EDuration="1.612985484s" totalImagesPullingTime="216.126366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:02.612535329 +0000 UTC m=+620.755023963" watchObservedRunningTime="2026-07-06 14:35:02.612985484 +0000 UTC m=+620.755474125" Jul 06 14:35:11.911182 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:11.911126 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:11.911555 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:11.911194 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:11.923936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:11.923912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:12.647115 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:12.647082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn" Jul 06 14:35:14.205515 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:14.205481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:35:14.306595 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:35:14.306562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:01.800869 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:36:01.800833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:01.922744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:36:01.922708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:03.088101 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:36:03.088066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:03.220822 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:36:03.220784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:36:03.327494 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:36:03.327449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:15.224408 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.224372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:15.324423 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.324387 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:37:15.324659 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.324582 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" podUID="5f94a900-4406-4c07-8106-3a7120697df5" containerName="manager" containerID="cri-o://c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab" gracePeriod=30 Jul 06 14:37:15.572589 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.572566 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:37:15.706204 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.706167 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7snp\" (UniqueName: \"kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp\") pod \"5f94a900-4406-4c07-8106-3a7120697df5\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " Jul 06 14:37:15.706398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.706311 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert\") pod \"5f94a900-4406-4c07-8106-3a7120697df5\" (UID: \"5f94a900-4406-4c07-8106-3a7120697df5\") " Jul 06 14:37:15.708586 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.708552 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp" (OuterVolumeSpecName: "kube-api-access-j7snp") pod "5f94a900-4406-4c07-8106-3a7120697df5" (UID: "5f94a900-4406-4c07-8106-3a7120697df5"). InnerVolumeSpecName "kube-api-access-j7snp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:37:15.708798 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.708759 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5f94a900-4406-4c07-8106-3a7120697df5" (UID: "5f94a900-4406-4c07-8106-3a7120697df5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:37:15.808153 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.808067 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7snp\" (UniqueName: \"kubernetes.io/projected/5f94a900-4406-4c07-8106-3a7120697df5-kube-api-access-j7snp\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:37:15.808153 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:15.808097 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f94a900-4406-4c07-8106-3a7120697df5-webhook-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:37:16.257885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.257850 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f94a900-4406-4c07-8106-3a7120697df5" containerID="c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab" exitCode=0 Jul 06 14:37:16.258361 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.257896 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" Jul 06 14:37:16.258361 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.257943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" event={"ID":"5f94a900-4406-4c07-8106-3a7120697df5","Type":"ContainerDied","Data":"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab"} Jul 06 14:37:16.258361 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.257997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-cjhss" event={"ID":"5f94a900-4406-4c07-8106-3a7120697df5","Type":"ContainerDied","Data":"bd1c7d75982c1b2d0e722cc41f52fad58f55fe4fac6a834b72200f42ba704c14"} Jul 06 14:37:16.258361 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.258032 2578 scope.go:117] "RemoveContainer" containerID="c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab" Jul 06 14:37:16.273170 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.273144 2578 scope.go:117] "RemoveContainer" containerID="c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab" Jul 06 14:37:16.273468 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:37:16.273449 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab\": container with ID starting with c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab not found: ID does not exist" containerID="c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab" Jul 06 14:37:16.273539 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.273481 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab"} err="failed to get container status \"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab\": rpc error: code = NotFound desc = could not find container \"c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab\": container with ID starting with c59cededc8c235a07f0a0b76e3801fc457df2b226000e01959d4c30fc261aeab not found: ID does not exist" Jul 06 14:37:16.288491 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.288461 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:37:16.290289 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.290269 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-cjhss"] Jul 06 14:37:16.455006 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:16.454975 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f94a900-4406-4c07-8106-3a7120697df5" path="/var/lib/kubelet/pods/5f94a900-4406-4c07-8106-3a7120697df5/volumes" Jul 06 14:37:17.006324 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.006290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:17.174222 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.174192 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-pgjck"] Jul 06 14:37:17.174626 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.174610 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f94a900-4406-4c07-8106-3a7120697df5" containerName="manager" Jul 06 14:37:17.174670 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.174629 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f94a900-4406-4c07-8106-3a7120697df5" containerName="manager" Jul 06 14:37:17.174738 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.174729 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f94a900-4406-4c07-8106-3a7120697df5" containerName="manager" Jul 06 14:37:17.178047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.178031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.183438 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.183412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 14:37:17.183585 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.183418 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-znnsl\"" Jul 06 14:37:17.183585 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.183519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 14:37:17.221344 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.221313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-kube-api-access-v4z2l\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.221545 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.221459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-webhook-cert\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.256800 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.256674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-pgjck"] Jul 06 14:37:17.322615 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.322587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-webhook-cert\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.323068 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.322647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-kube-api-access-v4z2l\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.325125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.325108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-webhook-cert\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.340588 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.340559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4z2l\" (UniqueName: \"kubernetes.io/projected/f6bd52af-722d-4c8d-a634-357cf6b9dc5c-kube-api-access-v4z2l\") pod \"maas-controller-6746c9cb6f-pgjck\" (UID: \"f6bd52af-722d-4c8d-a634-357cf6b9dc5c\") " pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.491275 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.491240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:17.649689 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:17.649663 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6746c9cb6f-pgjck"] Jul 06 14:37:17.651528 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:37:17.651503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bd52af_722d_4c8d_a634_357cf6b9dc5c.slice/crio-6684f5d852912fd19e8fa46bf5f8a07a86c040e6789bd88cc4c72c89c63b168e WatchSource:0}: Error finding container 6684f5d852912fd19e8fa46bf5f8a07a86c040e6789bd88cc4c72c89c63b168e: Status 404 returned error can't find the container with id 6684f5d852912fd19e8fa46bf5f8a07a86c040e6789bd88cc4c72c89c63b168e Jul 06 14:37:18.270575 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:18.270543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" event={"ID":"f6bd52af-722d-4c8d-a634-357cf6b9dc5c","Type":"ContainerStarted","Data":"a00a7c74d8578944064f4fe7657ff9b03e14bcaa0f687099e011344bcdacd34c"} Jul 06 14:37:18.270785 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:18.270597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" event={"ID":"f6bd52af-722d-4c8d-a634-357cf6b9dc5c","Type":"ContainerStarted","Data":"6684f5d852912fd19e8fa46bf5f8a07a86c040e6789bd88cc4c72c89c63b168e"} Jul 06 14:37:18.270785 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:18.270671 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:18.292245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:18.292192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" podStartSLOduration=0.844681926 podStartE2EDuration="1.292175228s" totalImagesPullingTime="447.493302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:18.290706105 +0000 UTC m=+756.433194766" watchObservedRunningTime="2026-07-06 14:37:18.292175228 +0000 UTC m=+756.434663862" Jul 06 14:37:29.284414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:29.284376 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6746c9cb6f-pgjck" Jul 06 14:37:56.632446 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:56.632415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:56.727715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:56.727688 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:37:56.873269 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:37:56.873235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:03.940284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:03.940205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:04.058953 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:04.058922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:04.206579 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:04.206501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:04.343213 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:04.343185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:10.926453 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:10.926411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:11.034201 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:11.034168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:38:42.342341 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:38:42.342307 2578 scope.go:117] "RemoveContainer" containerID="f6249b8a0489226c2d6f597deb15da77d2442e07e92f923646a205f3bfedf7ed" Jul 06 14:39:25.927091 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:39:25.927047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:14.628127 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:40:14.628096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:40:33.510217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:40:33.510186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:55.490133 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:41:55.490096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:41:55.592936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:41:55.592905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:06.610242 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:42:06.610209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:06.715522 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:42:06.715481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:06.810186 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:42:06.810157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:42:41.415009 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:42:41.414972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:45:00.166497 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.166459 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-qtlqw"] Jul 06 14:45:00.170136 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.170120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:00.173280 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.173259 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jt75v\"" Jul 06 14:45:00.192317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.192285 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-qtlqw"] Jul 06 14:45:00.331642 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.331601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj8hn\" (UniqueName: \"kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn\") pod \"maas-api-key-cleanup-29722485-qtlqw\" (UID: \"59ba7e81-3eef-4d33-894d-71ab44d14492\") " pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:00.433247 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.433154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj8hn\" (UniqueName: \"kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn\") pod \"maas-api-key-cleanup-29722485-qtlqw\" (UID: \"59ba7e81-3eef-4d33-894d-71ab44d14492\") " pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:00.442814 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.442758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj8hn\" (UniqueName: \"kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn\") pod \"maas-api-key-cleanup-29722485-qtlqw\" (UID: \"59ba7e81-3eef-4d33-894d-71ab44d14492\") " pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:00.480089 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.480061 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:00.618604 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.618585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722485-qtlqw"] Jul 06 14:45:00.621103 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:45:00.621073 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ba7e81_3eef_4d33_894d_71ab44d14492.slice/crio-069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386 WatchSource:0}: Error finding container 069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386: Status 404 returned error can't find the container with id 069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386 Jul 06 14:45:00.623114 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:00.623099 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:45:01.544344 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:01.544303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" event={"ID":"59ba7e81-3eef-4d33-894d-71ab44d14492","Type":"ContainerStarted","Data":"069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386"} Jul 06 14:45:04.560714 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:04.560679 2578 generic.go:356] "Generic (PLEG): container finished" podID="59ba7e81-3eef-4d33-894d-71ab44d14492" containerID="d370c2c8c619c4661398317abb7ca2b82c5d26bf6739d7da5931da7a0202505f" exitCode=0 Jul 06 14:45:04.561112 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:04.560779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" event={"ID":"59ba7e81-3eef-4d33-894d-71ab44d14492","Type":"ContainerDied","Data":"d370c2c8c619c4661398317abb7ca2b82c5d26bf6739d7da5931da7a0202505f"} Jul 06 14:45:05.700262 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:05.700231 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:45:05.785778 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:05.785748 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj8hn\" (UniqueName: \"kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn\") pod \"59ba7e81-3eef-4d33-894d-71ab44d14492\" (UID: \"59ba7e81-3eef-4d33-894d-71ab44d14492\") " Jul 06 14:45:05.788000 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:05.787966 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn" (OuterVolumeSpecName: "kube-api-access-tj8hn") pod "59ba7e81-3eef-4d33-894d-71ab44d14492" (UID: "59ba7e81-3eef-4d33-894d-71ab44d14492"). InnerVolumeSpecName "kube-api-access-tj8hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:45:05.887272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:05.887189 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj8hn\" (UniqueName: \"kubernetes.io/projected/59ba7e81-3eef-4d33-894d-71ab44d14492-kube-api-access-tj8hn\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:45:06.572588 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:06.572556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" event={"ID":"59ba7e81-3eef-4d33-894d-71ab44d14492","Type":"ContainerDied","Data":"069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386"} Jul 06 14:45:06.572758 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:06.572606 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="069985f014d3f6abc07d8434aa15deac8526a5c4f98fafc4c260073ff8d7b386" Jul 06 14:45:06.572758 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:45:06.572568 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722485-qtlqw" Jul 06 14:48:17.834664 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:17.834632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:19.139575 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:19.139541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:58.214450 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:58.214414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:59.098788 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:59.098740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:59.201726 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:59.201694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:48:59.542942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:48:59.542913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:05.558988 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:05.558952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:05.621885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:05.621856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:05.784791 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:05.784748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:05.854875 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:05.854788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.019649 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.019615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.108466 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.108439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.332674 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.332601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.491356 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.491326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.779398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.779370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:07.842514 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:07.842485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:09.277535 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:09.277500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:12.184544 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:12.184508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:12.341717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:12.341682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:12.427372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:12.427344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:12.549380 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:12.549308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:15.358210 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:15.358180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:18.824233 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.824201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:18.861820 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.861788 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:18.862490 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.862470 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ba7e81-3eef-4d33-894d-71ab44d14492" containerName="cleanup" Jul 06 14:49:18.862537 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.862495 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ba7e81-3eef-4d33-894d-71ab44d14492" containerName="cleanup" Jul 06 14:49:18.862616 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.862603 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ba7e81-3eef-4d33-894d-71ab44d14492" containerName="cleanup" Jul 06 14:49:18.866417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.866394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:18.870342 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.870324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-df5e6c40-openshift-default-dockercfg-qqrxw\"" Jul 06 14:49:18.879555 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.879531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:18.923950 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:18.923919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:19.007947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.007919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:19.026172 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026340 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026340 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026340 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026340 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlgt\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.026509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.026447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.127813 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.127813 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.127813 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.127813 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlgt\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128137 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.127942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128388 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.128291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128388 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.128338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128388 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.128375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.128540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.128605 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.128570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.130896 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.130873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.131019 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.131001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.142040 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.142020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.142472 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.142455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlgt\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt\") pod \"e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.178666 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.178646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:19.320485 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.320456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:19.321494 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:49:19.321467 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf79613_6caf_4800_85bb_62ce3ebe3bc3.slice/crio-1e1e2c07abf81020dc5b4805ab1dfd350b7123fb319973ed055fd641a622c06b WatchSource:0}: Error finding container 1e1e2c07abf81020dc5b4805ab1dfd350b7123fb319973ed055fd641a622c06b: Status 404 returned error can't find the container with id 1e1e2c07abf81020dc5b4805ab1dfd350b7123fb319973ed055fd641a622c06b Jul 06 14:49:19.323710 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.323679 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:19.323806 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.323783 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:19.323853 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.323820 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:19.827479 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.827445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerStarted","Data":"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08"} Jul 06 14:49:19.827954 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.827501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerStarted","Data":"1e1e2c07abf81020dc5b4805ab1dfd350b7123fb319973ed055fd641a622c06b"} Jul 06 14:49:19.851882 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:19.851813 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" podStartSLOduration=1.851789111 podStartE2EDuration="1.851789111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:19.850066638 +0000 UTC m=+1477.992555274" watchObservedRunningTime="2026-07-06 14:49:19.851789111 +0000 UTC m=+1477.994277754" Jul 06 14:49:20.126151 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.126070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:20.179464 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.179430 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:20.184396 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.184367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:20.232812 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.232754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:20.332678 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.332643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:20.458086 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.458054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:20.834172 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.834090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:20.834963 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:20.834934 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:21.041353 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:21.041318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:21.140696 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:21.140619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:22.700266 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:22.700221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:26.156337 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:26.156287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:26.229728 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:26.229692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:26.496794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:26.496727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:30.888511 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.888487 2578 generic.go:356] "Generic (PLEG): container finished" podID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerID="45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08" exitCode=0 Jul 06 14:49:30.888885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.888555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerDied","Data":"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08"} Jul 06 14:49:30.888992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.888978 2578 scope.go:117] "RemoveContainer" containerID="45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08" Jul 06 14:49:30.889903 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.889879 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:30.889956 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.889944 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:30.889990 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:30.889974 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:49:31.694701 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:31.694667 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:31.712495 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:31.712459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:31.813874 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:31.813831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:31.895529 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:31.895496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerStarted","Data":"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad"} Jul 06 14:49:31.895999 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:31.895616 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" containerID="cri-o://75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad" gracePeriod=30 Jul 06 14:49:33.882423 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:33.882385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:35.834473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:35.834446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:37.146996 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.146967 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:37.206753 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206717 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.206949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206791 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.206949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.206949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206858 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrlgt\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.206949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206902 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.206949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.207188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.206973 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.207188 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207042 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.207288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207195 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:49:37.207288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207255 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:49:37.207407 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token\") pod \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\" (UID: \"1bf79613-6caf-4800-85bb-62ce3ebe3bc3\") " Jul 06 14:49:37.207483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207381 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:49:37.207531 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207464 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:49:37.207880 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207823 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.207880 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207840 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istiod-ca-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.207880 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207848 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-workload-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.207880 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.207857 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-credential-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.208234 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.208003 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:49:37.209405 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.209384 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:49:37.209513 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.209436 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:49:37.209572 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.209536 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 14:49:37.209572 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.209539 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt" (OuterVolumeSpecName: "kube-api-access-wrlgt") pod "1bf79613-6caf-4800-85bb-62ce3ebe3bc3" (UID: "1bf79613-6caf-4800-85bb-62ce3ebe3bc3"). InnerVolumeSpecName "kube-api-access-wrlgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:49:37.309336 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.309302 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-token\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.309336 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.309329 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-podinfo\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.309336 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.309338 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-envoy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.309336 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.309347 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrlgt\" (UniqueName: \"kubernetes.io/projected/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-kube-api-access-wrlgt\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.309599 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.309355 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bf79613-6caf-4800-85bb-62ce3ebe3bc3-istio-data\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:49:37.924986 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.924948 2578 generic.go:356] "Generic (PLEG): container finished" podID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerID="75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad" exitCode=0 Jul 06 14:49:37.925191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.924997 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" Jul 06 14:49:37.925191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.925007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerDied","Data":"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad"} Jul 06 14:49:37.925191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.925101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw" event={"ID":"1bf79613-6caf-4800-85bb-62ce3ebe3bc3","Type":"ContainerDied","Data":"1e1e2c07abf81020dc5b4805ab1dfd350b7123fb319973ed055fd641a622c06b"} Jul 06 14:49:37.925191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.925132 2578 scope.go:117] "RemoveContainer" containerID="75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad" Jul 06 14:49:37.934722 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.934706 2578 scope.go:117] "RemoveContainer" containerID="45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08" Jul 06 14:49:37.942782 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.942749 2578 scope.go:117] "RemoveContainer" containerID="75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad" Jul 06 14:49:37.943041 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:49:37.943018 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad\": container with ID starting with 75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad not found: ID does not exist" containerID="75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad" Jul 06 14:49:37.943122 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.943053 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad"} err="failed to get container status \"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad\": rpc error: code = NotFound desc = could not find container \"75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad\": container with ID starting with 75f2ae35c1187cb7efe579248aa2f289d38b863f49ccbd109244e741546f18ad not found: ID does not exist" Jul 06 14:49:37.943122 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.943079 2578 scope.go:117] "RemoveContainer" containerID="45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08" Jul 06 14:49:37.943324 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:49:37.943306 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08\": container with ID starting with 45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08 not found: ID does not exist" containerID="45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08" Jul 06 14:49:37.943363 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.943331 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08"} err="failed to get container status \"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08\": rpc error: code = NotFound desc = could not find container \"45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08\": container with ID starting with 45fac24fb49c0f961c37297889805d4351bcedc4222dc972bba022f0715f0e08 not found: ID does not exist" Jul 06 14:49:37.952203 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.952179 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:37.954692 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:37.954671 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-df5e6c40-openshift-default-696796b76f-j6czw"] Jul 06 14:49:38.455473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:38.455431 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" path="/var/lib/kubelet/pods/1bf79613-6caf-4800-85bb-62ce3ebe3bc3/volumes" Jul 06 14:49:38.586526 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:38.586500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:38.681385 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:38.681342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:38.828109 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:38.828079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:38.927996 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:38.927968 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:40.078051 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:40.078021 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:40.204454 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:40.204406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:40.308119 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:40.308066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:40.526977 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:40.526944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:41.141386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:41.141350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:41.249280 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:41.249242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:41.869527 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:41.869502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:44.628503 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:44.628456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:44.761577 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:44.761539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:44.858551 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:44.858515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:45.020543 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:45.020508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:46.761535 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:46.761493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:51.473708 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:51.473655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:51.584706 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:51.584673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:51.971949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:51.971915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:52.076156 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:52.076121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:52.181135 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:52.181104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:49:53.539022 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:49:53.538987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:00.718573 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:00.718535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:00.848274 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:00.848238 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:00.947039 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:00.947013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:01.059455 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:01.059353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:01.558531 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:01.558503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:22.693949 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:22.693915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:27.520484 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:27.520431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:34.062718 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:34.062681 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:34.131493 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:34.131458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:34.214050 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:34.214009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:50.187640 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:50.187605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:58.036730 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:58.036692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:58.100452 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:58.100410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:50:58.183489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:50:58.183455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:08.770618 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:08.770589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:09.578990 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:09.578958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:16.266161 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:16.266120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:16.371531 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:16.371497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:16.482810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:16.482754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:16.589216 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:16.589102 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:17.459845 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:17.459783 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:17.600086 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:17.600048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:17.706191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:17.706158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:19.382003 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:19.381966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:25.529899 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:25.529868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:25.603793 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:25.603736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:26.214713 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:26.214676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:32.454963 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.454922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:32.557152 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.557123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:32.710171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.710071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:32.997890 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.997805 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:51:32.998305 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998287 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:32.998398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998308 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:32.998398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998320 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:32.998398 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998339 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:32.998554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998464 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:32.998554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:32.998479 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf79613-6caf-4800-85bb-62ce3ebe3bc3" containerName="istio-proxy" Jul 06 14:51:33.001740 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.001717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.004522 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.004501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-95005850-openshift-default-dockercfg-pxfp6\"" Jul 06 14:51:33.018102 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.018084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:33.032522 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.032498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:51:33.035602 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24r7\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.035937 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.035889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137443 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24r7\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.137925 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.137874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.138149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.138050 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.138149 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.138109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.138253 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.138192 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.138297 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.138274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.140284 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.140263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.140400 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.140344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.140493 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.140476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:33.148254 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.148224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.148408 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.148385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24r7\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7\") pod \"e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.311323 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.311230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:33.459525 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.459499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:51:33.461381 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:51:33.461353 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520dec6a_02f0_4f1c_a569_36236daa44e2.slice/crio-93ef0d6dc03be095d09759adc5a374ce815d5b1fffb2b45cbbdf9fd0445836f2 WatchSource:0}: Error finding container 93ef0d6dc03be095d09759adc5a374ce815d5b1fffb2b45cbbdf9fd0445836f2: Status 404 returned error can't find the container with id 93ef0d6dc03be095d09759adc5a374ce815d5b1fffb2b45cbbdf9fd0445836f2 Jul 06 14:51:33.463488 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.463452 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:33.463598 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.463520 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:33.463598 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.463549 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:33.513378 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:33.513351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerStarted","Data":"93ef0d6dc03be095d09759adc5a374ce815d5b1fffb2b45cbbdf9fd0445836f2"} Jul 06 14:51:34.520356 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:34.520316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerStarted","Data":"a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8"} Jul 06 14:51:34.545468 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:34.545407 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podStartSLOduration=2.545390571 podStartE2EDuration="2.545390571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:51:34.543192077 +0000 UTC m=+1612.685680711" watchObservedRunningTime="2026-07-06 14:51:34.545390571 +0000 UTC m=+1612.687879204" Jul 06 14:51:35.311953 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:35.311918 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:35.317080 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:35.317054 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:35.525752 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:35.525719 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:35.526660 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:35.526640 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:36.612509 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:36.612475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:36.714750 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:36.714699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:36.802809 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:36.802751 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:36.976470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:36.976415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:37.382551 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:37.382462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:37.488615 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:37.488579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:41.132073 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:41.132025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:41.777485 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:41.777451 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:41.873712 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:41.873657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:42.206954 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:42.206925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:48.596320 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.596285 2578 generic.go:356] "Generic (PLEG): container finished" podID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerID="a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8" exitCode=0 Jul 06 14:51:48.596926 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.596367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerDied","Data":"a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8"} Jul 06 14:51:48.596926 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.596887 2578 scope.go:117] "RemoveContainer" containerID="a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8" Jul 06 14:51:48.597952 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.597927 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:48.598021 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.597993 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:48.598057 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.598025 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:51:48.824807 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.824692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:48.993221 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:48.993186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:49.393459 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:49.393423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:49.604272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:49.604241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerStarted","Data":"1b86c9ffca70a06e6d4c9b26a8cb8076af0d2644ad565f85913969fb150c487e"} Jul 06 14:51:49.754554 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:49.754522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:49.946683 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:49.946652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:50.311845 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:50.311815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:50.312981 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:50.312954 2578 patch_prober.go:28] interesting pod/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 14:51:50.313101 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:50.313004 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 14:51:50.525877 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:50.525843 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:51.312211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:51.312169 2578 patch_prober.go:28] interesting pod/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 14:51:51.312623 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:51.312231 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 14:51:52.312226 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:52.312190 2578 patch_prober.go:28] interesting pod/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 14:51:52.312614 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:52.312258 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 14:51:53.312052 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:53.312008 2578 patch_prober.go:28] interesting pod/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 06 14:51:53.312239 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:53.312085 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 06 14:51:54.316311 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:54.316280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:54.317191 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:54.317175 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:51:56.182705 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.182674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:56.286264 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.286230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:56.425876 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.425842 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:51:56.426119 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.426095 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" containerID="cri-o://1b86c9ffca70a06e6d4c9b26a8cb8076af0d2644ad565f85913969fb150c487e" gracePeriod=30 Jul 06 14:51:56.452232 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.452139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:56.688049 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.688013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:56.806231 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.806139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:56.901985 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:56.901941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:51:57.055717 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:51:57.055683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:01.667845 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.667816 2578 generic.go:356] "Generic (PLEG): container finished" podID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerID="1b86c9ffca70a06e6d4c9b26a8cb8076af0d2644ad565f85913969fb150c487e" exitCode=0 Jul 06 14:52:01.668166 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.667893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerDied","Data":"1b86c9ffca70a06e6d4c9b26a8cb8076af0d2644ad565f85913969fb150c487e"} Jul 06 14:52:01.668166 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.668000 2578 scope.go:117] "RemoveContainer" containerID="a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8" Jul 06 14:52:01.686507 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:52:01.686487 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8\": container with ID starting with a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8 not found: ID does not exist" containerID="a0e379db083b4709c5331000578ac660bb4e9ad9eb041ca35bec35dc913af1c8" Jul 06 14:52:01.688434 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.688394 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:52:01.847176 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847195 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q24r7\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847263 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847341 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847377 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847443 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847476 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy\") pod \"520dec6a-02f0-4f1c-a569-36236daa44e2\" (UID: \"520dec6a-02f0-4f1c-a569-36236daa44e2\") " Jul 06 14:52:01.847698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847474 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:52:01.847698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847673 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:52:01.847944 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847737 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:52:01.847944 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.847852 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:52:01.848102 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.848078 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.848333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.848107 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-workload-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.848333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.848121 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-credential-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.848333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.848136 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/520dec6a-02f0-4f1c-a569-36236daa44e2-istiod-ca-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.848333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.848220 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:52:01.849808 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.849747 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 14:52:01.849942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.849917 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7" (OuterVolumeSpecName: "kube-api-access-q24r7") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "kube-api-access-q24r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:52:01.849942 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.849927 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:52:01.850202 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.850183 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "520dec6a-02f0-4f1c-a569-36236daa44e2" (UID: "520dec6a-02f0-4f1c-a569-36236daa44e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:52:01.949635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.949542 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-envoy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.949635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.949572 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-data\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.949635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.949580 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-token\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.949635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.949589 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q24r7\" (UniqueName: \"kubernetes.io/projected/520dec6a-02f0-4f1c-a569-36236daa44e2-kube-api-access-q24r7\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:01.949635 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:01.949599 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/520dec6a-02f0-4f1c-a569-36236daa44e2-istio-podinfo\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:52:02.674747 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:02.674716 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" Jul 06 14:52:02.675171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:02.674713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j" event={"ID":"520dec6a-02f0-4f1c-a569-36236daa44e2","Type":"ContainerDied","Data":"93ef0d6dc03be095d09759adc5a374ce815d5b1fffb2b45cbbdf9fd0445836f2"} Jul 06 14:52:02.675171 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:02.674857 2578 scope.go:117] "RemoveContainer" containerID="1b86c9ffca70a06e6d4c9b26a8cb8076af0d2644ad565f85913969fb150c487e" Jul 06 14:52:02.710541 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:02.710501 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:52:02.716686 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:02.716620 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-95005850-openshift-default-64cd759ccf-gnm6j"] Jul 06 14:52:03.582372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:03.582338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:03.689667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:03.689641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:03.788526 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:03.788493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:03.931235 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:03.931204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:04.455932 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:04.455898 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" path="/var/lib/kubelet/pods/520dec6a-02f0-4f1c-a569-36236daa44e2/volumes" Jul 06 14:52:10.045208 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:10.045163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:10.112047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:10.112014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:16.834648 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:16.834607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:17.306096 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:17.306060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:17.691078 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:17.691042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:20.674724 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:20.674690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:20.777212 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:20.777181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:20.908565 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:20.908539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:21.407453 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:21.407426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:21.508339 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:21.508306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:21.611524 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:21.611490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:25.184677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:25.184629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:38.920652 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:38.920615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:39.019971 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:39.019940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:42.505999 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:42.505969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:42.602639 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:42.602602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:52:47.507936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:52:47.507904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:13.102727 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:53:13.102640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:13.561585 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:53:13.561549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:19.197530 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:53:19.197495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:53:24.228737 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:53:24.228700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:01.086947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:01.086919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:01.741399 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:01.741374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:07.950505 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:07.950474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:23.446175 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:23.446139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:23.571574 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:23.571538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:23.774307 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:23.774216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:24.025755 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:24.025672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.148428 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:25.148395 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.236225 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:25.236191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:25.307659 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:25.307629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:26.073668 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:26.073634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:26.170132 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:26.170105 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:26.269868 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:26.269833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:27.687776 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:27.687746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:33.883431 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:33.883402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:33.948915 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:33.948874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:34.547612 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:34.547579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:40.808230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:40.808196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:40.876574 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:40.876536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:40.967265 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:40.967239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:41.071602 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:41.071512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:51.561964 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:51.561924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:54:51.901986 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:54:51.901891 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:12.893943 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:12.893903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:13.577376 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:13.577339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:18.997748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:18.997708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:19.097356 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:19.097327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:19.294736 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:19.294648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:19.611444 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:19.611357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:20.020330 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:20.020290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.665245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:22.665208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.761933 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:22.761903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.845936 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:22.845899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:22.988169 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:22.988087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:23.538755 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:23.538722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:23.638898 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:23.638863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:27.141874 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.141835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:27.477289 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.477246 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:27.763012 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.762935 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:55:27.763360 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763337 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.763412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763362 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.763412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763374 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.763412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763379 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.763567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763453 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.763567 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.763462 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="520dec6a-02f0-4f1c-a569-36236daa44e2" containerName="istio-proxy" Jul 06 14:55:27.766883 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.766863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.769357 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.769340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5e9a43-openshift-default-dockercfg-x2fxp\"" Jul 06 14:55:27.778885 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.778864 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:55:27.782209 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.782189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:27.819231 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l58b\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.819597 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.819512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920045 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.919998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920045 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l58b\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920317 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920606 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920606 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920702 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920806 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920806 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.920895 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.920855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.922601 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.922580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.922843 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.922824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.929031 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.929004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:27.929242 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:27.929215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l58b\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b\") pod \"e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:28.077412 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.077320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:28.155125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.155091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:28.230120 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.229997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:55:28.232830 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:55:28.232794 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6afe20_3421_4cb3_a8c8_3f2d97c2c661.slice/crio-88c8bf328b4ba23f0b5dba14fe8c15d1623dd5aceb2b2aac62aa60c48c6be176 WatchSource:0}: Error finding container 88c8bf328b4ba23f0b5dba14fe8c15d1623dd5aceb2b2aac62aa60c48c6be176: Status 404 returned error can't find the container with id 88c8bf328b4ba23f0b5dba14fe8c15d1623dd5aceb2b2aac62aa60c48c6be176 Jul 06 14:55:28.238380 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.238341 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:28.238478 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.238430 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:28.238518 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.238474 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:28.686302 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.686271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerStarted","Data":"8d3f6993054bb4476167f425e9aa2778194eca5a6978775b422c3f9174cdc491"} Jul 06 14:55:28.686471 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.686320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerStarted","Data":"88c8bf328b4ba23f0b5dba14fe8c15d1623dd5aceb2b2aac62aa60c48c6be176"} Jul 06 14:55:28.754349 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:28.754296 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podStartSLOduration=1.754279325 podStartE2EDuration="1.754279325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:28.752221208 +0000 UTC m=+1846.894709845" watchObservedRunningTime="2026-07-06 14:55:28.754279325 +0000 UTC m=+1846.896767959" Jul 06 14:55:29.078014 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:29.077911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:29.082718 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:29.082691 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:29.691719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:29.691687 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:29.692734 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:29.692714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:30.795372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:30.795337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.872637 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:30.872602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:30.945539 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:30.945502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.275063 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:31.275029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.532873 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:31.532721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:31.633719 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:31.633685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:35.296945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:35.296912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:39.627585 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:39.627548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:44.343827 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:44.343793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:44.445518 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:44.445486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:45.733973 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:45.733928 2578 patch_prober.go:28] interesting pod/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 14:55:45.734394 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:45.734011 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 14:55:46.784748 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.784712 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerID="8d3f6993054bb4476167f425e9aa2778194eca5a6978775b422c3f9174cdc491" exitCode=0 Jul 06 14:55:46.785237 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.784793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerDied","Data":"8d3f6993054bb4476167f425e9aa2778194eca5a6978775b422c3f9174cdc491"} Jul 06 14:55:46.785311 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.785257 2578 scope.go:117] "RemoveContainer" containerID="8d3f6993054bb4476167f425e9aa2778194eca5a6978775b422c3f9174cdc491" Jul 06 14:55:46.786278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.786252 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:46.786336 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.786318 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:46.786377 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:46.786356 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:55:47.791359 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:47.791317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerStarted","Data":"64d5b697dc03c1bd0a6056443773f722ef26f41877f4655ed8c4d2c0b1652868"} Jul 06 14:55:48.077918 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:48.077815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:48.078081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:48.077988 2578 patch_prober.go:28] interesting pod/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 14:55:48.078081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:48.078035 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 14:55:49.078747 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:49.078707 2578 patch_prober.go:28] interesting pod/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 14:55:49.079172 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:49.078795 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 14:55:50.078394 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:50.078360 2578 patch_prober.go:28] interesting pod/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 14:55:50.078575 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:50.078413 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 14:55:51.078015 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:51.077977 2578 patch_prober.go:28] interesting pod/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 06 14:55:51.078433 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:51.078039 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 06 14:55:52.081332 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:52.081303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:52.081781 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:52.081707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:52.082448 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:52.082430 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:55:53.284125 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:53.284094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:55:53.384437 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:55:53.384402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:03.543342 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:56:03.543267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:46.726085 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:56:46.726037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:53.973150 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:56:53.973113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:56:54.048259 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:56:54.048221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:15.254947 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:15.254918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:16.232128 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:16.232090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:16.421325 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:16.421295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:16.818014 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:16.817984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:16.919030 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:16.919001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:17.018992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:17.018958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:17.205907 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:17.205872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:22.010304 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:22.010274 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:40.126753 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:40.126714 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:40.220174 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:40.220144 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:53.169761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:53.169725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:57:53.274087 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:57:53.274057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:00.037704 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:00.037660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:00.386617 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:00.386536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:00.613229 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:00.613194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:00.838634 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:00.838604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.240620 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:01.240584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.440656 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:01.440620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.583238 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:01.583156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:01.855596 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:01.855509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:08.133647 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.133605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:08.210021 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.209990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:08.397578 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.397497 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:58:08.397830 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.397804 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" containerID="cri-o://64d5b697dc03c1bd0a6056443773f722ef26f41877f4655ed8c4d2c0b1652868" gracePeriod=30 Jul 06 14:58:08.422905 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.422869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:08.652867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:08.652755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:09.003362 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:09.003316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:09.344514 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:09.344439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:09.911288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:09.911242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:12.476899 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:12.476867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:12.566394 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:12.566356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:12.652636 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:12.652600 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:12.987498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:12.987464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:13.101372 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.101336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:13.200246 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.200213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:13.536211 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.536178 2578 generic.go:356] "Generic (PLEG): container finished" podID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerID="64d5b697dc03c1bd0a6056443773f722ef26f41877f4655ed8c4d2c0b1652868" exitCode=0 Jul 06 14:58:13.536632 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.536256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerDied","Data":"64d5b697dc03c1bd0a6056443773f722ef26f41877f4655ed8c4d2c0b1652868"} Jul 06 14:58:13.536632 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.536351 2578 scope.go:117] "RemoveContainer" containerID="8d3f6993054bb4476167f425e9aa2778194eca5a6978775b422c3f9174cdc491" Jul 06 14:58:13.655715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.655684 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:58:13.779214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779120 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779164 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779189 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779235 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l58b\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779313 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779339 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779419 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779413 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779481 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779459 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:13.779810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779494 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779585 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo\") pod \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\" (UID: \"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661\") " Jul 06 14:58:13.779810 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:13.779997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779830 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:58:13.779997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.779986 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.780180 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.780005 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istiod-ca-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.780180 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.780019 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-workload-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.780180 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.780032 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-credential-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.780488 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.780260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:13.781902 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.781878 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b" (OuterVolumeSpecName: "kube-api-access-7l58b") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "kube-api-access-7l58b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:58:13.782032 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.781897 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:58:13.782273 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.782257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:13.782342 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.782329 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" (UID: "5b6afe20-3421-4cb3-a8c8-3f2d97c2c661"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 14:58:13.881184 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.881142 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-token\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.881184 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.881176 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-envoy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.881184 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.881188 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-podinfo\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.881431 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.881199 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-istio-data\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:13.881431 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:13.881212 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l58b\" (UniqueName: \"kubernetes.io/projected/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661-kube-api-access-7l58b\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:14.542867 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:14.542837 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" Jul 06 14:58:14.543291 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:14.542842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw" event={"ID":"5b6afe20-3421-4cb3-a8c8-3f2d97c2c661","Type":"ContainerDied","Data":"88c8bf328b4ba23f0b5dba14fe8c15d1623dd5aceb2b2aac62aa60c48c6be176"} Jul 06 14:58:14.543291 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:14.542968 2578 scope.go:117] "RemoveContainer" containerID="64d5b697dc03c1bd0a6056443773f722ef26f41877f4655ed8c4d2c0b1652868" Jul 06 14:58:14.562824 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:14.562793 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:58:14.567333 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:14.567301 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5e9a43-openshift-default-6889767ccc-9wjmw"] Jul 06 14:58:16.456846 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:16.456814 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" path="/var/lib/kubelet/pods/5b6afe20-3421-4cb3-a8c8-3f2d97c2c661/volumes" Jul 06 14:58:16.993974 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:16.993938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:17.499261 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.499229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:17.933518 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.933490 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:17.940753 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.940710 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.941051 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.941034 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.941100 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.941063 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.941100 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.941070 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.941267 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.941247 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.941320 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.941276 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6afe20-3421-4cb3-a8c8-3f2d97c2c661" containerName="istio-proxy" Jul 06 14:58:17.944148 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.944127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:17.948498 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.948477 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-81b1b4-openshift-default-dockercfg-9vbw8\"" Jul 06 14:58:17.960036 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.960006 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:17.974365 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:17.974333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.096731 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.096683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:18.124669 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.124886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.124886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.124886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.124886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.124886 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.125138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.125138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.124979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h9xz\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.125138 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.125018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h9xz\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226413 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226618 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226618 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226618 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226828 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226828 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226828 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.226993 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.226940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.228922 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.228901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.229108 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.229088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.235181 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.235150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.235308 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.235267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h9xz\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz\") pod \"e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.254911 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.254882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:18.403560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.403359 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:18.406446 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:58:18.406409 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39622b34_762d_45c5_87f2_916c7bc967db.slice/crio-437f27403de1bc588d4aaac4a33a1b2fbe72f7009221f35514b199217de0b3be WatchSource:0}: Error finding container 437f27403de1bc588d4aaac4a33a1b2fbe72f7009221f35514b199217de0b3be: Status 404 returned error can't find the container with id 437f27403de1bc588d4aaac4a33a1b2fbe72f7009221f35514b199217de0b3be Jul 06 14:58:18.408587 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.408556 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:18.408688 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.408639 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:18.408752 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.408684 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:18.567147 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.567053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerStarted","Data":"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5"} Jul 06 14:58:18.567147 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.567116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerStarted","Data":"437f27403de1bc588d4aaac4a33a1b2fbe72f7009221f35514b199217de0b3be"} Jul 06 14:58:18.588837 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:18.588760 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podStartSLOduration=1.588738464 podStartE2EDuration="1.588738464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:18.58758653 +0000 UTC m=+2016.730075165" watchObservedRunningTime="2026-07-06 14:58:18.588738464 +0000 UTC m=+2016.731227098" Jul 06 14:58:19.255787 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:19.255733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:19.260483 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:19.260459 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:19.573038 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:19.572953 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:19.574014 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:19.573993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:20.779919 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:20.779879 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:22.188193 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:22.188163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:25.153934 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:25.153891 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:32.639804 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.639683 2578 generic.go:356] "Generic (PLEG): container finished" podID="39622b34-762d-45c5-87f2-916c7bc967db" containerID="afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5" exitCode=0 Jul 06 14:58:32.639804 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.639762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerDied","Data":"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5"} Jul 06 14:58:32.640296 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.640190 2578 scope.go:117] "RemoveContainer" containerID="afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5" Jul 06 14:58:32.641319 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.641291 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:32.641430 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.641359 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:32.641430 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:32.641394 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:33.420057 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:33.420017 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:33.651429 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:33.650466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerStarted","Data":"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af"} Jul 06 14:58:33.833093 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:33.832990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:34.016691 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.016657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:34.117519 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.117438 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:34.255470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.255437 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:34.256561 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.256539 2578 patch_prober.go:28] interesting pod/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 14:58:34.256667 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.256597 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 14:58:34.343272 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.343232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:34.573230 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:34.573192 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:35.256215 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:35.256169 2578 patch_prober.go:28] interesting pod/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 14:58:35.256703 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:35.256237 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 14:58:36.255692 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:36.255644 2578 patch_prober.go:28] interesting pod/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 14:58:36.255909 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:36.255712 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 14:58:37.255603 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:37.255560 2578 patch_prober.go:28] interesting pod/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 06 14:58:37.256037 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:37.255622 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 06 14:58:38.259392 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:38.259359 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:38.260473 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:38.260457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:40.165733 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:40.165699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.265414 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:40.265385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.444495 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:40.444414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.660612 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:40.660582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:40.931047 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:40.931010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:41.345884 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:41.345798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:41.562730 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:41.562699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:41.659757 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:41.659724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:41.872676 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:41.872645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:46.146619 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:46.146588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.423236 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.423189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.524500 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.524469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.722139 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.722057 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:47.722331 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.722306 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" containerID="cri-o://3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af" gracePeriod=30 Jul 06 14:58:47.732849 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.732818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:47.963897 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:47.963860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:48.330564 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:48.330529 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:48.668214 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:48.668180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:49.055992 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:49.055903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:51.875555 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:51.875525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:51.959301 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:51.959275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:52.032233 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:52.032200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:52.455064 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:52.455035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:52.691417 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:52.691379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:52.827217 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:52.827184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:52.991836 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:52.991759 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:53.058383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058351 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h9xz\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058561 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058401 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058561 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058434 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058561 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058545 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058606 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058644 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058650 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058697 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.058744 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:53.059081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058839 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy\") pod \"39622b34-762d-45c5-87f2-916c7bc967db\" (UID: \"39622b34-762d-45c5-87f2-916c7bc967db\") " Jul 06 14:58:53.059081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058938 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:53.059081 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.058993 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:58:53.059245 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.059224 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-credential-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.059299 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.059244 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.059299 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.059256 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39622b34-762d-45c5-87f2-916c7bc967db-istiod-ca-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.059299 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.059265 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-workload-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.059611 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.059473 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data" (OuterVolumeSpecName: "istio-data") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:53.061035 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.061010 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 14:58:53.061035 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.061024 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token" (OuterVolumeSpecName: "istio-token") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:58:53.061308 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.061288 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz" (OuterVolumeSpecName: "kube-api-access-7h9xz") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "kube-api-access-7h9xz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:58:53.061383 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.061367 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39622b34-762d-45c5-87f2-916c7bc967db" (UID: "39622b34-762d-45c5-87f2-916c7bc967db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 14:58:53.160456 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.160419 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h9xz\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-kube-api-access-7h9xz\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.160456 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.160450 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39622b34-762d-45c5-87f2-916c7bc967db-istio-token\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.160456 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.160460 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-data\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.160456 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.160467 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39622b34-762d-45c5-87f2-916c7bc967db-istio-podinfo\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.160794 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.160475 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39622b34-762d-45c5-87f2-916c7bc967db-istio-envoy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 14:58:53.757919 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.757881 2578 generic.go:356] "Generic (PLEG): container finished" podID="39622b34-762d-45c5-87f2-916c7bc967db" containerID="3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af" exitCode=0 Jul 06 14:58:53.758090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.757944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerDied","Data":"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af"} Jul 06 14:58:53.758090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.757949 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" Jul 06 14:58:53.758090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.757987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg" event={"ID":"39622b34-762d-45c5-87f2-916c7bc967db","Type":"ContainerDied","Data":"437f27403de1bc588d4aaac4a33a1b2fbe72f7009221f35514b199217de0b3be"} Jul 06 14:58:53.758090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.758008 2578 scope.go:117] "RemoveContainer" containerID="3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af" Jul 06 14:58:53.767591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.767570 2578 scope.go:117] "RemoveContainer" containerID="afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5" Jul 06 14:58:53.776278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.776258 2578 scope.go:117] "RemoveContainer" containerID="3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af" Jul 06 14:58:53.776575 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:58:53.776557 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af\": container with ID starting with 3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af not found: ID does not exist" containerID="3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af" Jul 06 14:58:53.776654 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.776584 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af"} err="failed to get container status \"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af\": rpc error: code = NotFound desc = could not find container \"3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af\": container with ID starting with 3f3d3060785cced3c7ced62906f4264690d1423e98aefa7d58f6ece5f057b8af not found: ID does not exist" Jul 06 14:58:53.776654 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.776601 2578 scope.go:117] "RemoveContainer" containerID="afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5" Jul 06 14:58:53.776846 ip-10-0-133-221 kubenswrapper[2578]: E0706 14:58:53.776826 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5\": container with ID starting with afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5 not found: ID does not exist" containerID="afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5" Jul 06 14:58:53.776892 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.776852 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5"} err="failed to get container status \"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5\": rpc error: code = NotFound desc = could not find container \"afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5\": container with ID starting with afe56bd3f0b203f50c86b3592f9f3bb8806a6a6d86c8eb622794249f375f90b5 not found: ID does not exist" Jul 06 14:58:53.788503 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.788474 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:53.790295 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:53.790273 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-81b1b4-openshift-default-7d84545469-pg6tg"] Jul 06 14:58:54.455749 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:54.455716 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39622b34-762d-45c5-87f2-916c7bc967db" path="/var/lib/kubelet/pods/39622b34-762d-45c5-87f2-916c7bc967db/volumes" Jul 06 14:58:56.334980 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.334949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:56.704709 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.704674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:56.995672 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.995593 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 14:58:56.996239 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996217 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.996239 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996241 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.996404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996262 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.996404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996271 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.996404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996372 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.996404 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.996384 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="39622b34-762d-45c5-87f2-916c7bc967db" containerName="istio-proxy" Jul 06 14:58:56.999801 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:56.999755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.002826 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.002799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-06dd21-openshift-default-dockercfg-zvjsd\"" Jul 06 14:58:57.013289 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.013268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 14:58:57.045736 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.045700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:57.101698 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.101945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.101945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.101945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.101945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.101945 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fchr\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.102278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.101991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.102278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.102031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.102278 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.102077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203288 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203489 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fchr\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203686 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.203840 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.203833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.204098 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.204072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.204386 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.204118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.205957 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.205932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.206048 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.206017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.212785 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.212743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.212883 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.212863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fchr\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr\") pod \"e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.282743 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.282658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:58:57.309864 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.309822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:57.457997 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.457966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 14:58:57.460001 ip-10-0-133-221 kubenswrapper[2578]: W0706 14:58:57.459973 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fba6935_e074_41ef_948e_41a625874a12.slice/crio-d058f49eec5dfb7b6b0aaaed8323ae66721204e20836c34d43c972cd5d3a290e WatchSource:0}: Error finding container d058f49eec5dfb7b6b0aaaed8323ae66721204e20836c34d43c972cd5d3a290e: Status 404 returned error can't find the container with id d058f49eec5dfb7b6b0aaaed8323ae66721204e20836c34d43c972cd5d3a290e Jul 06 14:58:57.462049 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.462019 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:57.462126 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.462083 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:57.462126 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.462111 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:58:57.782863 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.782826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerStarted","Data":"43cccdeaadc8c0d4d1432d2a907da054104ba9fd3bd2ac0011709832a141857c"} Jul 06 14:58:57.783071 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.782885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerStarted","Data":"d058f49eec5dfb7b6b0aaaed8323ae66721204e20836c34d43c972cd5d3a290e"} Jul 06 14:58:57.810180 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:57.810126 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podStartSLOduration=1.810109326 podStartE2EDuration="1.810109326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:57.809449304 +0000 UTC m=+2055.951937931" watchObservedRunningTime="2026-07-06 14:58:57.810109326 +0000 UTC m=+2055.952597961" Jul 06 14:58:58.310273 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:58.310229 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:58.315292 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:58.315270 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:58.788761 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:58.788725 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:58.789755 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:58.789737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:58:59.932715 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:58:59.932687 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:00.021445 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:00.021417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:00.086699 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:00.086668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:00.188046 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:00.187957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:00.511950 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:00.511869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:00.612309 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:00.612276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:04.483029 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:04.482944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:12.884964 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.884921 2578 generic.go:356] "Generic (PLEG): container finished" podID="4fba6935-e074-41ef-948e-41a625874a12" containerID="43cccdeaadc8c0d4d1432d2a907da054104ba9fd3bd2ac0011709832a141857c" exitCode=0 Jul 06 14:59:12.885395 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.884987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerDied","Data":"43cccdeaadc8c0d4d1432d2a907da054104ba9fd3bd2ac0011709832a141857c"} Jul 06 14:59:12.885443 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.885396 2578 scope.go:117] "RemoveContainer" containerID="43cccdeaadc8c0d4d1432d2a907da054104ba9fd3bd2ac0011709832a141857c" Jul 06 14:59:12.886470 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.886440 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:59:12.886541 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.886525 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:59:12.886591 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:12.886578 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 06 14:59:13.472376 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:13.472343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:13.573689 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:13.573650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:13.789673 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:13.789582 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:59:13.892930 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:13.892895 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerStarted","Data":"0e6c12c9e7e6f3d449520937123d9b75ac3db7ea442ba7a1cc80227016b7fb19"} Jul 06 14:59:14.310198 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:14.310161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:59:14.311114 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:14.311092 2578 patch_prober.go:28] interesting pod/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 14:59:14.311173 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:14.311140 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 14:59:15.310638 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:15.310600 2578 patch_prober.go:28] interesting pod/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 14:59:15.311122 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:15.310674 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 14:59:16.310377 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:16.310340 2578 patch_prober.go:28] interesting pod/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 14:59:16.310560 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:16.310402 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 14:59:17.310841 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:17.310805 2578 patch_prober.go:28] interesting pod/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 06 14:59:17.311231 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:17.310878 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 06 14:59:18.314139 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:18.314109 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:59:18.314553 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:18.314504 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:59:18.315116 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:18.315100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 14:59:19.697662 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:19.697634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:21.386677 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:21.386641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:21.487090 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:21.487050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:32.748215 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:32.748174 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 14:59:53.631671 ip-10-0-133-221 kubenswrapper[2578]: I0706 14:59:53.631633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:00:00.151362 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.151330 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-lcm8d"] Jul 06 15:00:00.153919 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.153901 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7"] Jul 06 15:00:00.154057 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.154036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:00.156215 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.156196 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl"] Jul 06 15:00:00.156351 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.156331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:00.157627 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.157611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jt75v\"" Jul 06 15:00:00.158490 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.158474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:00.168537 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.168399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-lcm8d"] Jul 06 15:00:00.171515 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.171482 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl"] Jul 06 15:00:00.174858 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.174833 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7"] Jul 06 15:00:00.220174 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.220132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6gdn\" (UniqueName: \"kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn\") pod \"maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7\" (UID: \"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:00.220365 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.220204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdcpv\" (UniqueName: \"kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv\") pod \"maas-api-key-cleanup-29722500-lcm8d\" (UID: \"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903\") " pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:00.220365 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.220251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqh2\" (UniqueName: \"kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2\") pod \"maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl\" (UID: \"cd00d382-c7aa-4df6-b9a4-74bd39543f68\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:00.321204 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.321160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6gdn\" (UniqueName: \"kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn\") pod \"maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7\" (UID: \"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:00.321204 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.321210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcpv\" (UniqueName: \"kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv\") pod \"maas-api-key-cleanup-29722500-lcm8d\" (UID: \"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903\") " pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:00.321434 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.321231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqh2\" (UniqueName: \"kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2\") pod \"maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl\" (UID: \"cd00d382-c7aa-4df6-b9a4-74bd39543f68\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:00.331516 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.331493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdcpv\" (UniqueName: \"kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv\") pod \"maas-api-key-cleanup-29722500-lcm8d\" (UID: \"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903\") " pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:00.331681 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.331664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqh2\" (UniqueName: \"kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2\") pod \"maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl\" (UID: \"cd00d382-c7aa-4df6-b9a4-74bd39543f68\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:00.331849 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.331826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6gdn\" (UniqueName: \"kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn\") pod \"maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7\" (UID: \"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:00.468864 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.468835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:00.478875 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.478852 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:00.485862 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.485842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:00.630589 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.630557 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-lcm8d"] Jul 06 15:00:00.635519 ip-10-0-133-221 kubenswrapper[2578]: W0706 15:00:00.635491 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff5dcf0_c695_4d0d_9a5b_bca2a2f3b903.slice/crio-34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505 WatchSource:0}: Error finding container 34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505: Status 404 returned error can't find the container with id 34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505 Jul 06 15:00:00.869512 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.869472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7"] Jul 06 15:00:00.870632 ip-10-0-133-221 kubenswrapper[2578]: W0706 15:00:00.870608 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba712bf9_7bd0_4c50_b71c_973cb02fb2ed.slice/crio-0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371 WatchSource:0}: Error finding container 0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371: Status 404 returned error can't find the container with id 0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371 Jul 06 15:00:00.871819 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:00.871796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl"] Jul 06 15:00:00.872972 ip-10-0-133-221 kubenswrapper[2578]: W0706 15:00:00.872941 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd00d382_c7aa_4df6_b9a4_74bd39543f68.slice/crio-7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d WatchSource:0}: Error finding container 7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d: Status 404 returned error can't find the container with id 7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d Jul 06 15:00:01.136008 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:01.135975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" event={"ID":"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed","Type":"ContainerStarted","Data":"0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371"} Jul 06 15:00:01.140869 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:01.140834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" event={"ID":"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903","Type":"ContainerStarted","Data":"cd3ffdb9f1c4161c972454773e7659fefd9fae216b86412526ab18c5e974fe25"} Jul 06 15:00:01.141002 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:01.140901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" event={"ID":"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903","Type":"ContainerStarted","Data":"34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505"} Jul 06 15:00:01.143323 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:01.143205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" event={"ID":"cd00d382-c7aa-4df6-b9a4-74bd39543f68","Type":"ContainerStarted","Data":"7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d"} Jul 06 15:00:01.171687 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:01.171630 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" podStartSLOduration=1.171612978 podStartE2EDuration="1.171612978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:01.170561178 +0000 UTC m=+2119.313049815" watchObservedRunningTime="2026-07-06 15:00:01.171612978 +0000 UTC m=+2119.314101611" Jul 06 15:00:02.149980 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.149949 2578 generic.go:356] "Generic (PLEG): container finished" podID="fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903" containerID="cd3ffdb9f1c4161c972454773e7659fefd9fae216b86412526ab18c5e974fe25" exitCode=0 Jul 06 15:00:02.150178 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.150052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" event={"ID":"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903","Type":"ContainerDied","Data":"cd3ffdb9f1c4161c972454773e7659fefd9fae216b86412526ab18c5e974fe25"} Jul 06 15:00:02.151475 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.151448 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd00d382-c7aa-4df6-b9a4-74bd39543f68" containerID="10700fa7a32f4438165a90ce40f2b2fa7f898bbe6909be1bc5907cb220edc023" exitCode=0 Jul 06 15:00:02.151604 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.151535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" event={"ID":"cd00d382-c7aa-4df6-b9a4-74bd39543f68","Type":"ContainerDied","Data":"10700fa7a32f4438165a90ce40f2b2fa7f898bbe6909be1bc5907cb220edc023"} Jul 06 15:00:02.152840 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.152820 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" containerID="8cd10d299dcc473b40fc9a23b2ff82085a4dbc5fa219b002396c4e282c17cfe4" exitCode=0 Jul 06 15:00:02.152941 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:02.152902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" event={"ID":"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed","Type":"ContainerDied","Data":"8cd10d299dcc473b40fc9a23b2ff82085a4dbc5fa219b002396c4e282c17cfe4"} Jul 06 15:00:03.303411 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.303384 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:03.333492 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.333468 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:03.350019 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.349991 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6gdn\" (UniqueName: \"kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn\") pod \"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed\" (UID: \"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed\") " Jul 06 15:00:03.353080 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.352734 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn" (OuterVolumeSpecName: "kube-api-access-r6gdn") pod "ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" (UID: "ba712bf9-7bd0-4c50-b71c-973cb02fb2ed"). InnerVolumeSpecName "kube-api-access-r6gdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:00:03.355431 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.355412 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:03.450760 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.450675 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdcpv\" (UniqueName: \"kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv\") pod \"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903\" (UID: \"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903\") " Jul 06 15:00:03.450760 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.450736 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgqh2\" (UniqueName: \"kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2\") pod \"cd00d382-c7aa-4df6-b9a4-74bd39543f68\" (UID: \"cd00d382-c7aa-4df6-b9a4-74bd39543f68\") " Jul 06 15:00:03.451172 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.451155 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6gdn\" (UniqueName: \"kubernetes.io/projected/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed-kube-api-access-r6gdn\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:00:03.452907 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.452886 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2" (OuterVolumeSpecName: "kube-api-access-cgqh2") pod "cd00d382-c7aa-4df6-b9a4-74bd39543f68" (UID: "cd00d382-c7aa-4df6-b9a4-74bd39543f68"). InnerVolumeSpecName "kube-api-access-cgqh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:00:03.452971 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.452899 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv" (OuterVolumeSpecName: "kube-api-access-gdcpv") pod "fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903" (UID: "fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903"). InnerVolumeSpecName "kube-api-access-gdcpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:00:03.553005 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.552966 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdcpv\" (UniqueName: \"kubernetes.io/projected/fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903-kube-api-access-gdcpv\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:00:03.553005 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:03.553008 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgqh2\" (UniqueName: \"kubernetes.io/projected/cd00d382-c7aa-4df6-b9a4-74bd39543f68-kube-api-access-cgqh2\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:00:04.164529 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.164498 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" Jul 06 15:00:04.164709 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.164484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl" event={"ID":"cd00d382-c7aa-4df6-b9a4-74bd39543f68","Type":"ContainerDied","Data":"7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d"} Jul 06 15:00:04.164709 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.164666 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7490784641b80cf29a625e2414e5221c0edab8845dcc2b770cd798b70b56d24d" Jul 06 15:00:04.165991 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.165971 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" Jul 06 15:00:04.166129 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.166014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7" event={"ID":"ba712bf9-7bd0-4c50-b71c-973cb02fb2ed","Type":"ContainerDied","Data":"0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371"} Jul 06 15:00:04.166129 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.166069 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd5f913bdd709bd47ee51b168433732cbb0bc1a3a83cae53cf4accff717d371" Jul 06 15:00:04.167406 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.167383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" event={"ID":"fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903","Type":"ContainerDied","Data":"34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505"} Jul 06 15:00:04.167510 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.167418 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-lcm8d" Jul 06 15:00:04.167510 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:00:04.167427 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34df62e0be9249b498fab2d17a74530b8e0ba9654f6ef8b6f5422152b5143505" Jul 06 15:01:53.444457 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:01:53.444419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:54.527694 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:01:54.527656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:01:58.725677 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:01:58.725644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:22.833203 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:22.833161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:40.954257 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:40.954223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:41.053974 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:41.053937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:42.803071 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:42.803028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:42.906143 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:42.906110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:58.863925 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:58.863892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:02:59.732691 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:02:59.732649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:09.217853 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:03:09.217809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:03:24.524229 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:03:24.524149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:01.409475 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:01.409443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:14.383961 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:14.383903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:14.484511 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:14.484474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:19.261177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:19.261142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:20.058751 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:20.058720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:21.172761 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:21.172703 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:21.636819 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:21.636711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:22.309051 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:22.309018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:22.409285 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:22.409249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:22.602820 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:22.602713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:04:22.604115 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:22.604075 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl"] Jul 06 15:04:22.608303 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:22.608280 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-e63e88-29722500-xn4vl"] Jul 06 15:04:24.456629 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:24.456586 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd00d382-c7aa-4df6-b9a4-74bd39543f68" path="/var/lib/kubelet/pods/cd00d382-c7aa-4df6-b9a4-74bd39543f68/volumes" Jul 06 15:04:26.673068 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:04:26.673038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:03.878500 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:03.878464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:04.167204 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:04.167168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:04.417539 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:04.417422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:04.613695 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:04.613661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:05.030281 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:05.030245 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7"] Jul 06 15:05:05.032360 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:05.032333 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-06dd21-29722500-9mfh7"] Jul 06 15:05:05.398592 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:05.398507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:05.464290 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:05.464257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:06.456034 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:06.455999 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" path="/var/lib/kubelet/pods/ba712bf9-7bd0-4c50-b71c-973cb02fb2ed/volumes" Jul 06 15:05:11.281716 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.281686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:11.343411 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.343383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:11.545756 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.545669 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 15:05:11.545948 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.545930 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" containerID="cri-o://0e6c12c9e7e6f3d449520937123d9b75ac3db7ea442ba7a1cc80227016b7fb19" gracePeriod=30 Jul 06 15:05:11.560982 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.560954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:11.874252 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:11.874162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:16.774324 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.774289 2578 generic.go:356] "Generic (PLEG): container finished" podID="4fba6935-e074-41ef-948e-41a625874a12" containerID="0e6c12c9e7e6f3d449520937123d9b75ac3db7ea442ba7a1cc80227016b7fb19" exitCode=0 Jul 06 15:05:16.774815 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.774370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerDied","Data":"0e6c12c9e7e6f3d449520937123d9b75ac3db7ea442ba7a1cc80227016b7fb19"} Jul 06 15:05:16.774815 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.774432 2578 scope.go:117] "RemoveContainer" containerID="43cccdeaadc8c0d4d1432d2a907da054104ba9fd3bd2ac0011709832a141857c" Jul 06 15:05:16.816219 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.816157 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 15:05:16.947664 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947631 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fchr\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.947890 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947693 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.947890 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947718 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.947890 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947788 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.947890 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.947890 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947881 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.948177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.948177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.947942 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.948177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948016 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:05:16.948177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948033 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket\") pod \"4fba6935-e074-41ef-948e-41a625874a12\" (UID: \"4fba6935-e074-41ef-948e-41a625874a12\") " Jul 06 15:05:16.948401 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948384 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-certs\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:16.948401 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948028 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:05:16.948509 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948224 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:05:16.948674 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948616 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:05:16.948953 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.948921 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:05:16.950104 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.950082 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr" (OuterVolumeSpecName: "kube-api-access-4fchr") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "kube-api-access-4fchr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:05:16.950259 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.950239 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:05:16.950307 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.950236 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 15:05:16.950307 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.950273 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fba6935-e074-41ef-948e-41a625874a12" (UID: "4fba6935-e074-41ef-948e-41a625874a12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:05:16.972507 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:16.972486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7wps4_3481cd65-d9b3-49e9-9fde-e8d3c7d736c6/manager/0.log" Jul 06 15:05:17.049045 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049015 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-workload-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049045 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049042 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fba6935-e074-41ef-948e-41a625874a12-istio-podinfo\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049045 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049051 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fba6935-e074-41ef-948e-41a625874a12-istiod-ca-cert\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049268 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049061 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-data\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049268 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049069 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-istio-envoy\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049268 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049077 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-istio-token\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049268 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049084 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fba6935-e074-41ef-948e-41a625874a12-credential-socket\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.049268 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.049093 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fchr\" (UniqueName: \"kubernetes.io/projected/4fba6935-e074-41ef-948e-41a625874a12-kube-api-access-4fchr\") on node \"ip-10-0-133-221.ec2.internal\" DevicePath \"\"" Jul 06 15:05:17.104641 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.104569 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gm7l4_3d02cf08-3cdf-4197-83de-54d5bece5e6c/manager/0.log" Jul 06 15:05:17.388166 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.388088 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722485-qtlqw_59ba7e81-3eef-4d33-894d-71ab44d14492/cleanup/0.log" Jul 06 15:05:17.511428 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.511398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-lcm8d_fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903/cleanup/0.log" Jul 06 15:05:17.631028 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.630996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6746c9cb6f-pgjck_f6bd52af-722d-4c8d-a634-357cf6b9dc5c/manager/0.log" Jul 06 15:05:17.781352 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.781324 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" Jul 06 15:05:17.781807 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.781370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh" event={"ID":"4fba6935-e074-41ef-948e-41a625874a12","Type":"ContainerDied","Data":"d058f49eec5dfb7b6b0aaaed8323ae66721204e20836c34d43c972cd5d3a290e"} Jul 06 15:05:17.781807 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.781430 2578 scope.go:117] "RemoveContainer" containerID="0e6c12c9e7e6f3d449520937123d9b75ac3db7ea442ba7a1cc80227016b7fb19" Jul 06 15:05:17.808738 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.808709 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 15:05:17.813353 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:17.813323 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-06dd21-openshift-default-7c6ff47c67-pt4rh"] Jul 06 15:05:18.014341 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:18.014315 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9447c645c-cjfnn_0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1/copy-manifests/0.log" Jul 06 15:05:18.022296 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:18.022258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9447c645c-cjfnn_0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1/manager/0.log" Jul 06 15:05:18.455609 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:18.455573 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fba6935-e074-41ef-948e-41a625874a12" path="/var/lib/kubelet/pods/4fba6935-e074-41ef-948e-41a625874a12/volumes" Jul 06 15:05:21.184672 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:21.184636 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42l6hr_8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0/istio-proxy/0.log" Jul 06 15:05:21.445611 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:21.445518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d848d496-5d7nh_0fe76766-0b18-4ced-b5c3-56b690e22678/kube-auth-proxy/0.log" Jul 06 15:05:22.402470 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:22.402441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-q9h5v_60948a81-86a4-4c7b-9284-8ad45588b834/main/0.log" Jul 06 15:05:22.643658 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:22.643624 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fmnbc_41021cc1-dcbf-44e6-b4a9-e74fede81c95/main/0.log" Jul 06 15:05:23.006337 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:23.006305 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nkbhn_fedb53b1-cacd-4945-8e0f-cc4730a69ab9/main/0.log" Jul 06 15:05:26.877684 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:26.877638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:26.942622 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:26.942571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" limit=1024 Jul 06 15:05:29.749053 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:29.749014 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gmkl8_6b0d5885-d8ea-4834-96d2-8fe004010744/global-pull-secret-syncer/0.log" Jul 06 15:05:29.906785 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:29.906739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cf4k6_cff848a7-2a35-49ce-8f8f-bdf507f316a6/konnectivity-agent/0.log" Jul 06 15:05:30.040311 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:30.040194 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-221.ec2.internal_42f9f05fde052bd22d7e2259b719ab44/haproxy/0.log" Jul 06 15:05:37.761104 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.760992 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/alertmanager/0.log" Jul 06 15:05:37.788507 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.788480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/config-reloader/0.log" Jul 06 15:05:37.822531 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.822506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/kube-rbac-proxy-web/0.log" Jul 06 15:05:37.851087 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.851062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/kube-rbac-proxy/0.log" Jul 06 15:05:37.882663 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.882633 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/kube-rbac-proxy-metric/0.log" Jul 06 15:05:37.916576 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.916548 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/prom-label-proxy/0.log" Jul 06 15:05:37.944376 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:37.944349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7428f73c-fe54-45c2-b856-8b0aaa276ea2/init-config-reloader/0.log" Jul 06 15:05:38.044669 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.044638 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vt789_13fc8be2-0285-4c47-9049-f06174392068/kube-state-metrics/0.log" Jul 06 15:05:38.108939 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.108913 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vt789_13fc8be2-0285-4c47-9049-f06174392068/kube-rbac-proxy-main/0.log" Jul 06 15:05:38.159706 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.159671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-vt789_13fc8be2-0285-4c47-9049-f06174392068/kube-rbac-proxy-self/0.log" Jul 06 15:05:38.232357 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.232329 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86988bd656-q9xmc_94a22d49-b674-4df1-88cb-1a6e979ee7bc/metrics-server/0.log" Jul 06 15:05:38.270649 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.270625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-mpmhp_1da72a84-41c2-49fe-b81c-e2c34d090f89/monitoring-plugin/0.log" Jul 06 15:05:38.481062 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.481030 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8jp5_8daa4865-ff66-4ae5-b07c-15eeaa46ef5b/node-exporter/0.log" Jul 06 15:05:38.505993 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.505962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8jp5_8daa4865-ff66-4ae5-b07c-15eeaa46ef5b/kube-rbac-proxy/0.log" Jul 06 15:05:38.532728 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.532698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8jp5_8daa4865-ff66-4ae5-b07c-15eeaa46ef5b/init-textfile/0.log" Jul 06 15:05:38.566085 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.566054 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frmpz_e5777ff9-44b0-4ff4-b79c-0ec496e461dc/kube-rbac-proxy-main/0.log" Jul 06 15:05:38.591811 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.591743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frmpz_e5777ff9-44b0-4ff4-b79c-0ec496e461dc/kube-rbac-proxy-self/0.log" Jul 06 15:05:38.617626 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.617602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frmpz_e5777ff9-44b0-4ff4-b79c-0ec496e461dc/openshift-state-metrics/0.log" Jul 06 15:05:38.658169 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.658140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/prometheus/0.log" Jul 06 15:05:38.683463 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.683437 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/config-reloader/0.log" Jul 06 15:05:38.718341 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.718299 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/thanos-sidecar/0.log" Jul 06 15:05:38.745155 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.745094 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/kube-rbac-proxy-web/0.log" Jul 06 15:05:38.770339 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.770312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/kube-rbac-proxy/0.log" Jul 06 15:05:38.796079 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.796055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/kube-rbac-proxy-thanos/0.log" Jul 06 15:05:38.824583 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.824557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95bf0ac1-7277-4555-81fb-e04c1c8f6bda/init-config-reloader/0.log" Jul 06 15:05:38.858248 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.858225 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-qt6pt_2aa73771-abfd-4f4c-875e-e915e99d9326/prometheus-operator/0.log" Jul 06 15:05:38.889019 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.888994 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-qt6pt_2aa73771-abfd-4f4c-875e-e915e99d9326/kube-rbac-proxy/0.log" Jul 06 15:05:38.919283 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.919256 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-z4hbw_875c4f62-e239-4376-994e-9da7f194ebd8/prometheus-operator-admission-webhook/0.log" Jul 06 15:05:38.955518 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.955492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7799f686d8-tpcnl_86ec2be2-d83a-4a20-9e7d-ce6fad636b8a/telemeter-client/0.log" Jul 06 15:05:38.991706 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:38.991675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7799f686d8-tpcnl_86ec2be2-d83a-4a20-9e7d-ce6fad636b8a/reload/0.log" Jul 06 15:05:39.030174 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.030108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7799f686d8-tpcnl_86ec2be2-d83a-4a20-9e7d-ce6fad636b8a/kube-rbac-proxy/0.log" Jul 06 15:05:39.074633 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.074604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/thanos-query/0.log" Jul 06 15:05:39.106298 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.106271 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/kube-rbac-proxy-web/0.log" Jul 06 15:05:39.135263 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.135235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/kube-rbac-proxy/0.log" Jul 06 15:05:39.164302 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.164276 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/prom-label-proxy/0.log" Jul 06 15:05:39.192377 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.192353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/kube-rbac-proxy-rules/0.log" Jul 06 15:05:39.219538 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.219505 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-778fd4886c-95dhm_67092fb2-0192-4a68-a3c8-50b11f9f5027/kube-rbac-proxy-metrics/0.log" Jul 06 15:05:39.325779 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.325689 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2"] Jul 06 15:05:39.326134 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326121 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" Jul 06 15:05:39.326177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326137 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" Jul 06 15:05:39.326177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326153 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903" containerName="cleanup" Jul 06 15:05:39.326177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326159 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903" containerName="cleanup" Jul 06 15:05:39.326177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326167 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd00d382-c7aa-4df6-b9a4-74bd39543f68" containerName="cleanup" Jul 06 15:05:39.326177 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326173 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd00d382-c7aa-4df6-b9a4-74bd39543f68" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326188 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326195 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326255 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd00d382-c7aa-4df6-b9a4-74bd39543f68" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326265 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326272 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326279 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba712bf9-7bd0-4c50-b71c-973cb02fb2ed" containerName="cleanup" Jul 06 15:05:39.326329 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.326285 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fba6935-e074-41ef-948e-41a625874a12" containerName="istio-proxy" Jul 06 15:05:39.331028 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.331010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.334819 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.334800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8frwf\"/\"openshift-service-ca.crt\"" Jul 06 15:05:39.336058 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.336041 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8frwf\"/\"default-dockercfg-dstt7\"" Jul 06 15:05:39.336173 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.336072 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8frwf\"/\"kube-root-ca.crt\"" Jul 06 15:05:39.340147 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.340122 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2"] Jul 06 15:05:39.459257 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.459216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-proc\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.459448 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.459275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgflg\" (UniqueName: \"kubernetes.io/projected/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-kube-api-access-wgflg\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.459448 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.459329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-podres\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.459448 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.459360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-sys\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.459448 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.459387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-lib-modules\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560271 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-sys\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560429 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-lib-modules\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560429 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-proc\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560429 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-sys\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560429 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgflg\" (UniqueName: \"kubernetes.io/projected/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-kube-api-access-wgflg\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560593 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-podres\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560593 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-proc\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560593 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-lib-modules\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.560593 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.560542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-podres\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.570659 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.570632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgflg\" (UniqueName: \"kubernetes.io/projected/52796e1e-3ec5-40c1-9ea2-47cc08c1683b-kube-api-access-wgflg\") pod \"perf-node-gather-daemonset-52kj2\" (UID: \"52796e1e-3ec5-40c1-9ea2-47cc08c1683b\") " pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.643445 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.643356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.780153 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.780125 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2"] Jul 06 15:05:39.782254 ip-10-0-133-221 kubenswrapper[2578]: W0706 15:05:39.782222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod52796e1e_3ec5_40c1_9ea2_47cc08c1683b.slice/crio-5ce86670a3f1bbd9152b41a22d27f18f5a87c59cf1cc0f7ef02aa3cb10093983 WatchSource:0}: Error finding container 5ce86670a3f1bbd9152b41a22d27f18f5a87c59cf1cc0f7ef02aa3cb10093983: Status 404 returned error can't find the container with id 5ce86670a3f1bbd9152b41a22d27f18f5a87c59cf1cc0f7ef02aa3cb10093983 Jul 06 15:05:39.902275 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.902175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" event={"ID":"52796e1e-3ec5-40c1-9ea2-47cc08c1683b","Type":"ContainerStarted","Data":"fd4cdacba3a322f28697c5a2f65b5c2c6ffdd92c34e6c057ec3809c768cb52c3"} Jul 06 15:05:39.902275 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.902240 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:39.902275 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.902261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" event={"ID":"52796e1e-3ec5-40c1-9ea2-47cc08c1683b","Type":"ContainerStarted","Data":"5ce86670a3f1bbd9152b41a22d27f18f5a87c59cf1cc0f7ef02aa3cb10093983"} Jul 06 15:05:39.919570 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:39.919527 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" podStartSLOduration=0.919513418 podStartE2EDuration="919.513418ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:05:39.918736416 +0000 UTC m=+2458.061225047" watchObservedRunningTime="2026-07-06 15:05:39.919513418 +0000 UTC m=+2458.062002051" Jul 06 15:05:41.600317 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:41.600285 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-mtn2l_d2ecd67a-0d65-4ebd-ba68-836b66c4011d/download-server/0.log" Jul 06 15:05:43.367338 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:43.367310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mr4gm_c323ed90-d9f4-41b5-bab8-025bc682feef/dns/0.log" Jul 06 15:05:43.394322 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:43.394288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mr4gm_c323ed90-d9f4-41b5-bab8-025bc682feef/kube-rbac-proxy/0.log" Jul 06 15:05:43.543461 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:43.543425 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jxqkf_cfa5c9fe-3db4-4fb4-9e1d-f3132ffa70d4/dns-node-resolver/0.log" Jul 06 15:05:44.168142 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:44.168111 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7wqq_82a5b689-bc4f-4362-b551-a9eb79e0805d/node-ca/0.log" Jul 06 15:05:45.204949 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:45.204916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42l6hr_8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0/istio-proxy/0.log" Jul 06 15:05:45.430301 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:45.430269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d848d496-5d7nh_0fe76766-0b18-4ced-b5c3-56b690e22678/kube-auth-proxy/0.log" Jul 06 15:05:45.918600 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:45.918575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8frwf/perf-node-gather-daemonset-52kj2" Jul 06 15:05:46.422733 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:46.422705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bp6nf_28cb5cdd-06e8-4eaa-8d3d-d85c987d35e6/serve-healthcheck-canary/0.log" Jul 06 15:05:47.035152 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:47.035123 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dqgb_98942fc4-9280-4b3e-8617-62d15605aa6c/kube-rbac-proxy/0.log" Jul 06 15:05:47.063898 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:47.063868 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dqgb_98942fc4-9280-4b3e-8617-62d15605aa6c/exporter/0.log" Jul 06 15:05:47.091638 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:47.091611 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6dqgb_98942fc4-9280-4b3e-8617-62d15605aa6c/extractor/0.log" Jul 06 15:05:50.061914 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.061882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7wps4_3481cd65-d9b3-49e9-9fde-e8d3c7d736c6/manager/0.log" Jul 06 15:05:50.200110 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.200025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42l6hr_8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0/istio-proxy/0.log" Jul 06 15:05:50.200990 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.200970 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gm7l4_3d02cf08-3cdf-4197-83de-54d5bece5e6c/manager/0.log" Jul 06 15:05:50.326446 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.326421 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722485-qtlqw_59ba7e81-3eef-4d33-894d-71ab44d14492/cleanup/0.log" Jul 06 15:05:50.356605 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.356574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-lcm8d_fff5dcf0-c695-4d0d-9a5b-bca2a2f3b903/cleanup/0.log" Jul 06 15:05:50.418874 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.418823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d848d496-5d7nh_0fe76766-0b18-4ced-b5c3-56b690e22678/kube-auth-proxy/0.log" Jul 06 15:05:50.458104 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.458027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6746c9cb6f-pgjck_f6bd52af-722d-4c8d-a634-357cf6b9dc5c/manager/0.log" Jul 06 15:05:50.609397 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.609366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9447c645c-cjfnn_0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1/manager/0.log" Jul 06 15:05:50.637714 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:50.637690 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9447c645c-cjfnn_0c19dd55-b4ef-45fd-b9c1-f84b879bfdc1/copy-manifests/0.log" Jul 06 15:05:51.798673 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:51.798645 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42l6hr_8ff1a6ab-56ff-4c2c-be8b-fb4bb11531e0/istio-proxy/0.log" Jul 06 15:05:52.001264 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:52.001234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d848d496-5d7nh_0fe76766-0b18-4ced-b5c3-56b690e22678/kube-auth-proxy/0.log" Jul 06 15:05:52.248469 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:52.248441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b6868f88d-mvbj4_c148f003-4a56-4766-932e-ea897793493a/manager/0.log" Jul 06 15:05:52.314622 ip-10-0-133-221 kubenswrapper[2578]: I0706 15:05:52.314584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ttl4j_305faa74-4e5f-4b16-8624-b1d04ca42dae/openshift-lws-operator/0.log"